Detecting and preventing “multiple-account” cheating in massive open online courses

We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment qu...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers and education 2016-09, Vol.100, p.71-80
Hauptverfasser: Northcutt, Curtis G., Ho, Andrew D., Chuang, Isaac L.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 80
container_issue
container_start_page 71
container_title Computers and education
container_volume 100
creator Northcutt, Curtis G.
Ho, Andrew D.
Chuang, Isaac L.
description We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses. •We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.
doi_str_mv 10.1016/j.compedu.2016.04.008
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1825514897</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0360131516300896</els_id><sourcerecordid>1825514897</sourcerecordid><originalsourceid>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</originalsourceid><addsrcrecordid>eNqFkMtKxDAUhoMoOI4-gtClm9ZcmjZdiYxXGHCj6C5k0lPN0CY1aQfczYPoy82TmJlx7-rw81_gfAidE5wRTIrLZaZd10M9ZjTKDOcZxuIATYgoWVoK-naIJpgVOCWM8GN0EsISY5wXOZ-g1xsYQA_GvifK1knvYQV2Jzfr725sB9O3kCqt3WiHzfon0R-gdr6xSadCMCtIXA82cbY1FpIY9AHCKTpqVBvg7O9O0cvd7fPsIZ0_3T_OruepZqIaUoV5BQuAApp6URZQKE5ZzVXONQEODaaENiQXlFaKVKLCED1WlbrQgmq2YFN0sd_tvfscIQyyM0FD2yoLbgySCMp5HKjKGOX7qPYuBA-N7L3plP-SBMstSLmUfyDlFqTEuYwgY-9q34P4x8qAl0EbsBpq4yM6WTvzz8Iv7-eCag</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1825514897</pqid></control><display><type>article</type><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</creator><creatorcontrib>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</creatorcontrib><description>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses. •We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</description><identifier>ISSN: 0360-1315</identifier><identifier>EISSN: 1873-782X</identifier><identifier>DOI: 10.1016/j.compedu.2016.04.008</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Architecture for educational technology system ; Assessments ; Certificates ; Cheating detection ; Computer assisted instruction ; Distance education ; Educational certification ; Educational Data Mining (EDM) ; Estimates ; Learning communities ; Lifelong learning ; Massive Open Online Courses (MOOCs) ; Online ; Pedagogical issues ; Reproduction ; Security ; Strategy ; Teaching/learning strategies</subject><ispartof>Computers and education, 2016-09, Vol.100, p.71-80</ispartof><rights>2016 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</citedby><cites>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</cites><orcidid>0000-0002-2423-1300</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compedu.2016.04.008$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Northcutt, Curtis G.</creatorcontrib><creatorcontrib>Ho, Andrew D.</creatorcontrib><creatorcontrib>Chuang, Isaac L.</creatorcontrib><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><title>Computers and education</title><description>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses. •We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</description><subject>Architecture for educational technology system</subject><subject>Assessments</subject><subject>Certificates</subject><subject>Cheating detection</subject><subject>Computer assisted instruction</subject><subject>Distance education</subject><subject>Educational certification</subject><subject>Educational Data Mining (EDM)</subject><subject>Estimates</subject><subject>Learning communities</subject><subject>Lifelong learning</subject><subject>Massive Open Online Courses (MOOCs)</subject><subject>Online</subject><subject>Pedagogical issues</subject><subject>Reproduction</subject><subject>Security</subject><subject>Strategy</subject><subject>Teaching/learning strategies</subject><issn>0360-1315</issn><issn>1873-782X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNqFkMtKxDAUhoMoOI4-gtClm9ZcmjZdiYxXGHCj6C5k0lPN0CY1aQfczYPoy82TmJlx7-rw81_gfAidE5wRTIrLZaZd10M9ZjTKDOcZxuIATYgoWVoK-naIJpgVOCWM8GN0EsISY5wXOZ-g1xsYQA_GvifK1knvYQV2Jzfr725sB9O3kCqt3WiHzfon0R-gdr6xSadCMCtIXA82cbY1FpIY9AHCKTpqVBvg7O9O0cvd7fPsIZ0_3T_OruepZqIaUoV5BQuAApp6URZQKE5ZzVXONQEODaaENiQXlFaKVKLCED1WlbrQgmq2YFN0sd_tvfscIQyyM0FD2yoLbgySCMp5HKjKGOX7qPYuBA-N7L3plP-SBMstSLmUfyDlFqTEuYwgY-9q34P4x8qAl0EbsBpq4yM6WTvzz8Iv7-eCag</recordid><startdate>201609</startdate><enddate>201609</enddate><creator>Northcutt, Curtis G.</creator><creator>Ho, Andrew D.</creator><creator>Chuang, Isaac L.</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2423-1300</orcidid></search><sort><creationdate>201609</creationdate><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><author>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Architecture for educational technology system</topic><topic>Assessments</topic><topic>Certificates</topic><topic>Cheating detection</topic><topic>Computer assisted instruction</topic><topic>Distance education</topic><topic>Educational certification</topic><topic>Educational Data Mining (EDM)</topic><topic>Estimates</topic><topic>Learning communities</topic><topic>Lifelong learning</topic><topic>Massive Open Online Courses (MOOCs)</topic><topic>Online</topic><topic>Pedagogical issues</topic><topic>Reproduction</topic><topic>Security</topic><topic>Strategy</topic><topic>Teaching/learning strategies</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Northcutt, Curtis G.</creatorcontrib><creatorcontrib>Ho, Andrew D.</creatorcontrib><creatorcontrib>Chuang, Isaac L.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers and education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Northcutt, Curtis G.</au><au>Ho, Andrew D.</au><au>Chuang, Isaac L.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Detecting and preventing “multiple-account” cheating in massive open online courses</atitle><jtitle>Computers and education</jtitle><date>2016-09</date><risdate>2016</risdate><volume>100</volume><spage>71</spage><epage>80</epage><pages>71-80</pages><issn>0360-1315</issn><eissn>1873-782X</eissn><abstract>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses. •We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.compedu.2016.04.008</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0002-2423-1300</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0360-1315
ispartof Computers and education, 2016-09, Vol.100, p.71-80
issn 0360-1315
1873-782X
language eng
recordid cdi_proquest_miscellaneous_1825514897
source Elsevier ScienceDirect Journals Complete
subjects Architecture for educational technology system
Assessments
Certificates
Cheating detection
Computer assisted instruction
Distance education
Educational certification
Educational Data Mining (EDM)
Estimates
Learning communities
Lifelong learning
Massive Open Online Courses (MOOCs)
Online
Pedagogical issues
Reproduction
Security
Strategy
Teaching/learning strategies
title Detecting and preventing “multiple-account” cheating in massive open online courses
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T08%3A41%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Detecting%20and%20preventing%20%E2%80%9Cmultiple-account%E2%80%9D%20cheating%20in%20massive%20open%20online%20courses&rft.jtitle=Computers%20and%20education&rft.au=Northcutt,%20Curtis%20G.&rft.date=2016-09&rft.volume=100&rft.spage=71&rft.epage=80&rft.pages=71-80&rft.issn=0360-1315&rft.eissn=1873-782X&rft_id=info:doi/10.1016/j.compedu.2016.04.008&rft_dat=%3Cproquest_cross%3E1825514897%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1825514897&rft_id=info:pmid/&rft_els_id=S0360131516300896&rfr_iscdi=true