Human Computation
Papers from the 2011 AAAI Workshop
Luis von Ahn, Panagiotis G. Ipeirotis, Cochairs
Technical Report WS-11-11 published by The AAAI Press, Menlo Park, California
This technical report is also available in book and CD format.
Contents
Beat the Machine: Challenging Workers to Find the Unknown Unknowns
Josh M. Attenberg, Pagagiotis G. Ipeirotis, Foster Provost
An Extendable Toolkit for Managing Quality of Human-Based Electronic Services
David Bermbach, Robert Kern, Pascal Wichmann, Sandra Rath, Christian Zirpins
Labor Allocation in Paid Crowdsourcing: Experimental Evidence on Positioning, Nudges and Prices
Dana Chandler, John Joseph Horton
Digitalkoot: Making Old Archives Accessible Using Crowdsourcing
Otto Chrons, Sami Sundell
What’s the Right Price? Pricing Tasks for Finishing on Time
Siamak Faradani, Bjoern Hartmann, Panagiotis G. Ipeirotis
Error Identification and Correction in Human Computation: Lessons from the WPA
David Alan Grier
An Iterative Dual Pathway Structure for Speech-to-Text Transcription
Beatrice Liem, Haoqi Zhang, Yiling Chen
Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing
David Oleson, Alexander Sorokin, Greg Laughlin, Vaughn Hester, John Le, Lukas Biewald
CrowdSight: Rapidly Prototyping Intelligent Visual Processing Apps
Mario Rodriguez, James Davis
Pricing Tasks in Online Labor Markets
Yaron Singer, Manas Mittal
Honesty in an Online Labor Market
Siddharth Suri, Daniel G. Goldstein, Winter A. Mason
Human Intelligence Needs Artificial Intelligence
Daniel S. Weld, . Mausam, Peng Dai
Robust Active Learning Using Crowdsourced Annotations for Activity Recognition
Liyue Zhao, Gita Sukthankar, Rahul Sukthankar
Towards Task Recommendation in Micro-Task Markets
Vamsi Ambati, Stephan Vogel, Jaime Carbonell
Developing Scripts to Teach Social Skills: Can the Crowd Assist the Author?
Fatima A. Boujarwah, Jennifer G. Kim, Gregory D. Abowd, Rosa I. Arriaga
Making Searchable Melodies: Human versus Machine
Mark Brozier Cartwright, Zafar Rafii, Jinyu Han, Bryan Pardo
Improving Consensus Accuracy via Z-Score and Weighted Voting
Hyun Joon Jung, Matthew Lease
Turkomatic: Automatic, Recursive Task and Workflow Design for Mechanical Turk
Anand Pramod Kulkarni, Matthew Can, Björn Hartmann
On Quality Control and Machine Learning in Crowdsourcing
Matthew Lease
CrowdLang — First Steps Towards Programmable Human Computers for General Computation
Patrick Minder, Abraham Bernstein
PulaCloud: Using Human Computation to Enable Development at the Bottom of the Economic Ladder
Andrew W. Schriner, Daniel B. Oerther, James G. Uber
CollabMap: Augmenting Maps Using the Wisdom of Crowds
Ruben Stranders, Sarvapali D. Ramchurn, Bing Shi, Nicholas R. Jennings
Beyond Independent Agreement: A Tournament Selection Approach for Quality Assurance of Human Computation Tasks
Yu-An Sun, Shourya Roy, Greg Little
MuSweeper: An Extensive Game for Collecting Mutual Exclusions
Tao-Hsuan Chang, Cheng-wei Chan, Jane Yung-jen Hsu
MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid
Prayag Narula, Philipp Gutheim, David Rolnitzky, Anand Kulkarni, Björn Hartmann