AAAI Publications, Second AAAI Conference on Human Computation and Crowdsourcing

Font Size: 
Quality Control for Crowdsourced Enumeration Tasks
Shunsuke Kajimura, Yukino Baba, Hiroshi Kajino, Hisashi Kashima

Last modified: 2014-09-05

Abstract


Quality control is one of the central issues in crowdsourcing research. In this paper, we consider a quality control problem of crowdsourced enumeration tasks that request workers to enumerate possible answers as many as possible. Since workers neither necessarily provide correct answers nor provide exactly the same answers even if the answers indicate the same idea, we propose a two-stage quality control method consisting of the answer clustering stage and the reliability estimation stage.

Full Text: PDF