Towards social norm design for crowdsourcing markets

  • Chien Ju Ho
  • , Yu Zhang
  • , Jennifer Wortman Vaughan
  • , Mihaela Van Der Schaar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Scopus citations

Abstract

Crowdsourcing markets, such as Amazon Mechanical Turk, provide a platform for matching prospective workers around the world with tasks. However, they are often plagued by workers who attempt to exert as little effort as possible, and requesters who deny workers payment for their labor. For crowdsourcing markets to succeed, it is essential to discourage such behavior. With this in mind, we propose a framework for the design and analysis of incentive mechanisms based on social norms, which consist of a set of rules that participants are expected to follow, and a mechanism for updating participants' public reputations based on whether or not they do. We start by considering the most basic version of our model, which contains only homogeneous participants and randomly matches workers with tasks. The optimal social norm in this setting turns out to be a simple, easily comprehensible incentive mechanism in which market participants are encouraged to play a tit-for-tat-like strategy. This simple mechanism is optimal even when the set of market participants changes dynamically over time, or when some fraction of the participants may be irrational. In addition to the basic model, we demonstrate how this framework can be applied to situations in which there are heterogeneous users by giving several illustrating examples. This work is a first step towards a complete theory of incentive design for crowdsourcing systems. We hope to build upon this framework and explore more interesting and practical aspects of real online labor markets in our future work.

Original languageEnglish
Title of host publicationHuman Computation - Papers from the 2012 AAAI Workshop, Technical Report
Pages94-100
Number of pages7
StatePublished - 2012
Event2012 AAAI Workshop - Toronto, ON, Canada
Duration: Jul 23 2012Jul 23 2012

Publication series

NameAAAI Workshop - Technical Report
VolumeWS-12-08

Conference

Conference2012 AAAI Workshop
Country/TerritoryCanada
CityToronto, ON
Period07/23/1207/23/12

Fingerprint

Dive into the research topics of 'Towards social norm design for crowdsourcing markets'. Together they form a unique fingerprint.

Cite this