Worker-Contributed Data Utility Measurement for Visual Crowdsensing Systems

Visual crowdsensing is successfully applied in numerous application areas, yet little work has been done on measuring and improving the quality of worker contributed visual data. Rather than evaluating the visual quality based on traditional metrics such as resolution, we focus on data diversity, which is crucial for a broad stream of visual crowdsensing tasks. Two representative diversity-oriented task types are studied, namely static object imagery and evolving event photography. The former aims to collect multi-facet/aspect yet low redundant data about a stationary object, while the latter wants to detect and collect details of key scenes throughout an event. We link these quality needs with data utility and propose a unified visual crowdsensing framework called UtiPay. Data utility is characterized by the macro and micro diversity needs: at the macro level, the pyramid-tree approach is proposed for multi-attribute-based data grouping; at the micro level, we use several strategies for intra-group data selection and worker contribution measurement. To study the impact of our proposed utility measurement approaches, we propose two utility-enhanced payment schemes as incentive mechanisms: Uti and Uti-Bid. Experiments over several user studies with a total of 43 subjects validate the performance of UtiPay for measuring and enhancing the data quality of visual crowdsensing tasks.