AAAI Publications, Third AAAI Conference on Human Computation and Crowdsourcing

Font Size: 
Acquiring Reliable Ratings from the Crowd
Beatrice Valeri, Shady Elbassuoni, Sihem Amer-Yahia

Last modified: 2015-09-23


We address the problem of acquiring reliable ratings of items such as restaurants or movies from the crowd. We propose a crowdsourcing platform that takes into consideration the workers’ skills with respect to the items being rated and assigns workers the best items to rate. Our platform focuses on acquiring ratings from skilled workers and for items that only have a few ratings. We evaluate the effectiveness of our system using a real-world dataset about restaurants.


crowdsourcing; ratings; worker skills; underexposed items

Full Text: PDF