A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk

A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hara, Kotaro, Adams, Abi, Milland, Kristy, Savage, Saiph, Callison-Burch, Chris, Bigham, Jeffrey
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Hara, Kotaro
Adams, Abi
Milland, Kristy
Savage, Saiph
Callison-Burch, Chris
Bigham, Jeffrey
description A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis revealed that workers earned a median hourly wage of only ~\$2/h, and only 4% earned more than \$7.25/h. The average requester pays more than \$11/h, although lower-paying requesters post much more work. Our wage calculations are influenced by how unpaid work is included in our wage calculations, e.g., time spent searching for tasks, working on tasks that are rejected, and working on tasks that are ultimately not submitted. We further explore the characteristics of tasks and working patterns that yield higher hourly wages. Our analysis informs future platform design and worker tools to create a more positive future for crowd work.
doi_str_mv 10.48550/arxiv.1712.05796
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1712_05796</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1712_05796</sourcerecordid><originalsourceid>FETCH-LOGICAL-a676-ddfb703f346e69cf90060661c256fbc676923093d3f9839b325a60e6372080ac3</originalsourceid><addsrcrecordid>eNotj71OwzAURr0woMIDMOGNKeHGt76Ox6gNP1IRSyTG6MaxwWqaIgcqytMTCtORPh190hHiqoB8WWoNt5y-4iEvTKFy0MbSuagrueYPztYpHvwoq5GH4xQnuQ_yZZ-2Pk03suY0xvF1Hmdhx98znrx74zE6HmTzmbYX4izwMPnLfy5Ec1c3q4ds83z_uKo2GZOhrO9DZwADLsmTdcECEBAVTmkKnZsVqxAs9hhsibZDpZnAExoFJbDDhbj-uz11tO8p7jgd29-e9tSDP7DNQ5g</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk</title><source>arXiv.org</source><creator>Hara, Kotaro ; Adams, Abi ; Milland, Kristy ; Savage, Saiph ; Callison-Burch, Chris ; Bigham, Jeffrey</creator><creatorcontrib>Hara, Kotaro ; Adams, Abi ; Milland, Kristy ; Savage, Saiph ; Callison-Burch, Chris ; Bigham, Jeffrey</creatorcontrib><description>A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis revealed that workers earned a median hourly wage of only ~\$2/h, and only 4% earned more than \$7.25/h. The average requester pays more than \$11/h, although lower-paying requesters post much more work. Our wage calculations are influenced by how unpaid work is included in our wage calculations, e.g., time spent searching for tasks, working on tasks that are rejected, and working on tasks that are ultimately not submitted. We further explore the characteristics of tasks and working patterns that yield higher hourly wages. Our analysis informs future platform design and worker tools to create a more positive future for crowd work.</description><identifier>DOI: 10.48550/arxiv.1712.05796</identifier><language>eng</language><subject>Computer Science - Computers and Society ; Computer Science - Human-Computer Interaction</subject><creationdate>2017-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,781,886</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1712.05796$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1712.05796$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Hara, Kotaro</creatorcontrib><creatorcontrib>Adams, Abi</creatorcontrib><creatorcontrib>Milland, Kristy</creatorcontrib><creatorcontrib>Savage, Saiph</creatorcontrib><creatorcontrib>Callison-Burch, Chris</creatorcontrib><creatorcontrib>Bigham, Jeffrey</creatorcontrib><title>A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk</title><description>A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis revealed that workers earned a median hourly wage of only ~\$2/h, and only 4% earned more than \$7.25/h. The average requester pays more than \$11/h, although lower-paying requesters post much more work. Our wage calculations are influenced by how unpaid work is included in our wage calculations, e.g., time spent searching for tasks, working on tasks that are rejected, and working on tasks that are ultimately not submitted. We further explore the characteristics of tasks and working patterns that yield higher hourly wages. Our analysis informs future platform design and worker tools to create a more positive future for crowd work.</description><subject>Computer Science - Computers and Society</subject><subject>Computer Science - Human-Computer Interaction</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr0woMIDMOGNKeHGt76Ox6gNP1IRSyTG6MaxwWqaIgcqytMTCtORPh190hHiqoB8WWoNt5y-4iEvTKFy0MbSuagrueYPztYpHvwoq5GH4xQnuQ_yZZ-2Pk03suY0xvF1Hmdhx98znrx74zE6HmTzmbYX4izwMPnLfy5Ec1c3q4ds83z_uKo2GZOhrO9DZwADLsmTdcECEBAVTmkKnZsVqxAs9hhsibZDpZnAExoFJbDDhbj-uz11tO8p7jgd29-e9tSDP7DNQ5g</recordid><startdate>20171214</startdate><enddate>20171214</enddate><creator>Hara, Kotaro</creator><creator>Adams, Abi</creator><creator>Milland, Kristy</creator><creator>Savage, Saiph</creator><creator>Callison-Burch, Chris</creator><creator>Bigham, Jeffrey</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20171214</creationdate><title>A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk</title><author>Hara, Kotaro ; Adams, Abi ; Milland, Kristy ; Savage, Saiph ; Callison-Burch, Chris ; Bigham, Jeffrey</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a676-ddfb703f346e69cf90060661c256fbc676923093d3f9839b325a60e6372080ac3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Computer Science - Computers and Society</topic><topic>Computer Science - Human-Computer Interaction</topic><toplevel>online_resources</toplevel><creatorcontrib>Hara, Kotaro</creatorcontrib><creatorcontrib>Adams, Abi</creatorcontrib><creatorcontrib>Milland, Kristy</creatorcontrib><creatorcontrib>Savage, Saiph</creatorcontrib><creatorcontrib>Callison-Burch, Chris</creatorcontrib><creatorcontrib>Bigham, Jeffrey</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Hara, Kotaro</au><au>Adams, Abi</au><au>Milland, Kristy</au><au>Savage, Saiph</au><au>Callison-Burch, Chris</au><au>Bigham, Jeffrey</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk</atitle><date>2017-12-14</date><risdate>2017</risdate><abstract>A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis revealed that workers earned a median hourly wage of only ~\$2/h, and only 4% earned more than \$7.25/h. The average requester pays more than \$11/h, although lower-paying requesters post much more work. Our wage calculations are influenced by how unpaid work is included in our wage calculations, e.g., time spent searching for tasks, working on tasks that are rejected, and working on tasks that are ultimately not submitted. We further explore the characteristics of tasks and working patterns that yield higher hourly wages. Our analysis informs future platform design and worker tools to create a more positive future for crowd work.</abstract><doi>10.48550/arxiv.1712.05796</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1712.05796
ispartof
issn
language eng
recordid cdi_arxiv_primary_1712_05796
source arXiv.org
subjects Computer Science - Computers and Society
Computer Science - Human-Computer Interaction
title A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-15T05%3A11%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Data-Driven%20Analysis%20of%20Workers'%20Earnings%20on%20Amazon%20Mechanical%20Turk&rft.au=Hara,%20Kotaro&rft.date=2017-12-14&rft_id=info:doi/10.48550/arxiv.1712.05796&rft_dat=%3Carxiv_GOX%3E1712_05796%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true