AAAI Publications, Third AAAI Conference on Human Computation and Crowdsourcing

Font Size: 
To Play or Not to Play: Interactions between Response Quality and Task Complexity in Games and Paid Crowdsourcing
Markus Krause, René Kizilcec

Last modified: 2015-09-23


Digital games are a viable alternative to accomplish crowdsourcing tasks that would traditionally require paid online labor. This study compares the quality of crowdsourcing with games and paid crowdsourcing for simple and complex annotation tasks in a controlled exper-iment. While no difference in quality was found for the simple task, paid contributors’ response quality was sub-stantially lower than players’ quality for the complex task (92% vs. 78% average accuracy). Results suggest that crowdsourcing with games provides similar and potentially even higher response quality relative to paid crowdsourcing.


Human Computation, Games, GWAP, Games with a purpose

Full Text: PDF