Detecting and preventing “multiple-account” cheating in massive open online courses
We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment qu...
Gespeichert in:
Veröffentlicht in: | Computers and education 2016-09, Vol.100, p.71-80 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 80 |
---|---|
container_issue | |
container_start_page | 71 |
container_title | Computers and education |
container_volume | 100 |
creator | Northcutt, Curtis G. Ho, Andrew D. Chuang, Isaac L. |
description | We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses.
•We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications. |
doi_str_mv | 10.1016/j.compedu.2016.04.008 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1825514897</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0360131516300896</els_id><sourcerecordid>1825514897</sourcerecordid><originalsourceid>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</originalsourceid><addsrcrecordid>eNqFkMtKxDAUhoMoOI4-gtClm9ZcmjZdiYxXGHCj6C5k0lPN0CY1aQfczYPoy82TmJlx7-rw81_gfAidE5wRTIrLZaZd10M9ZjTKDOcZxuIATYgoWVoK-naIJpgVOCWM8GN0EsISY5wXOZ-g1xsYQA_GvifK1knvYQV2Jzfr725sB9O3kCqt3WiHzfon0R-gdr6xSadCMCtIXA82cbY1FpIY9AHCKTpqVBvg7O9O0cvd7fPsIZ0_3T_OruepZqIaUoV5BQuAApp6URZQKE5ZzVXONQEODaaENiQXlFaKVKLCED1WlbrQgmq2YFN0sd_tvfscIQyyM0FD2yoLbgySCMp5HKjKGOX7qPYuBA-N7L3plP-SBMstSLmUfyDlFqTEuYwgY-9q34P4x8qAl0EbsBpq4yM6WTvzz8Iv7-eCag</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1825514897</pqid></control><display><type>article</type><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</creator><creatorcontrib>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</creatorcontrib><description>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses.
•We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</description><identifier>ISSN: 0360-1315</identifier><identifier>EISSN: 1873-782X</identifier><identifier>DOI: 10.1016/j.compedu.2016.04.008</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Architecture for educational technology system ; Assessments ; Certificates ; Cheating detection ; Computer assisted instruction ; Distance education ; Educational certification ; Educational Data Mining (EDM) ; Estimates ; Learning communities ; Lifelong learning ; Massive Open Online Courses (MOOCs) ; Online ; Pedagogical issues ; Reproduction ; Security ; Strategy ; Teaching/learning strategies</subject><ispartof>Computers and education, 2016-09, Vol.100, p.71-80</ispartof><rights>2016 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</citedby><cites>FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</cites><orcidid>0000-0002-2423-1300</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compedu.2016.04.008$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Northcutt, Curtis G.</creatorcontrib><creatorcontrib>Ho, Andrew D.</creatorcontrib><creatorcontrib>Chuang, Isaac L.</creatorcontrib><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><title>Computers and education</title><description>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses.
•We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</description><subject>Architecture for educational technology system</subject><subject>Assessments</subject><subject>Certificates</subject><subject>Cheating detection</subject><subject>Computer assisted instruction</subject><subject>Distance education</subject><subject>Educational certification</subject><subject>Educational Data Mining (EDM)</subject><subject>Estimates</subject><subject>Learning communities</subject><subject>Lifelong learning</subject><subject>Massive Open Online Courses (MOOCs)</subject><subject>Online</subject><subject>Pedagogical issues</subject><subject>Reproduction</subject><subject>Security</subject><subject>Strategy</subject><subject>Teaching/learning strategies</subject><issn>0360-1315</issn><issn>1873-782X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNqFkMtKxDAUhoMoOI4-gtClm9ZcmjZdiYxXGHCj6C5k0lPN0CY1aQfczYPoy82TmJlx7-rw81_gfAidE5wRTIrLZaZd10M9ZjTKDOcZxuIATYgoWVoK-naIJpgVOCWM8GN0EsISY5wXOZ-g1xsYQA_GvifK1knvYQV2Jzfr725sB9O3kCqt3WiHzfon0R-gdr6xSadCMCtIXA82cbY1FpIY9AHCKTpqVBvg7O9O0cvd7fPsIZ0_3T_OruepZqIaUoV5BQuAApp6URZQKE5ZzVXONQEODaaENiQXlFaKVKLCED1WlbrQgmq2YFN0sd_tvfscIQyyM0FD2yoLbgySCMp5HKjKGOX7qPYuBA-N7L3plP-SBMstSLmUfyDlFqTEuYwgY-9q34P4x8qAl0EbsBpq4yM6WTvzz8Iv7-eCag</recordid><startdate>201609</startdate><enddate>201609</enddate><creator>Northcutt, Curtis G.</creator><creator>Ho, Andrew D.</creator><creator>Chuang, Isaac L.</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2423-1300</orcidid></search><sort><creationdate>201609</creationdate><title>Detecting and preventing “multiple-account” cheating in massive open online courses</title><author>Northcutt, Curtis G. ; Ho, Andrew D. ; Chuang, Isaac L.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c389t-a059ebee6efdb76e6a523d5a45c1e5ef0212f148229a19890e5a4397c6c82c3b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Architecture for educational technology system</topic><topic>Assessments</topic><topic>Certificates</topic><topic>Cheating detection</topic><topic>Computer assisted instruction</topic><topic>Distance education</topic><topic>Educational certification</topic><topic>Educational Data Mining (EDM)</topic><topic>Estimates</topic><topic>Learning communities</topic><topic>Lifelong learning</topic><topic>Massive Open Online Courses (MOOCs)</topic><topic>Online</topic><topic>Pedagogical issues</topic><topic>Reproduction</topic><topic>Security</topic><topic>Strategy</topic><topic>Teaching/learning strategies</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Northcutt, Curtis G.</creatorcontrib><creatorcontrib>Ho, Andrew D.</creatorcontrib><creatorcontrib>Chuang, Isaac L.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers and education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Northcutt, Curtis G.</au><au>Ho, Andrew D.</au><au>Chuang, Isaac L.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Detecting and preventing “multiple-account” cheating in massive open online courses</atitle><jtitle>Computers and education</jtitle><date>2016-09</date><risdate>2016</risdate><volume>100</volume><spage>71</spage><epage>80</epage><pages>71-80</pages><issn>0360-1315</issn><eissn>1873-782X</eissn><abstract>We describe a cheating strategy enabled by the features of massive open online courses (MOOCs) and detectable by virtue of the sophisticated data systems that MOOCs provide. The strategy, Copying Answers using Multiple Existences Online (CAMEO), involves a user who gathers solutions to assessment questions using a “harvester” account and then submits correct answers using a separate “master” account. We use a small-scale experiment to verify CAMEO and estimate a “lower bound” for its prevalence among 1.9 million course participants in 115 MOOCs from two universities. Using conservative thresholds, we estimate CAMEO prevalence at 1237 certificates, accounting for 1.3% of the certificates in the 69 MOOCs with CAMEO users. Among earners of 20 or more certificates, 25% have used the CAMEO strategy. CAMEO users are more likely to be young, male, and international than other MOOC certificate earners. We identify preventive strategies that can decrease CAMEO rates and show evidence of their effectiveness in science courses.
•We detect a cheating strategy used in Massive Open Online Courses (MOOCs).•We call this strategy, “Copying Answers using Multiple Existences Online” (CAMEO).•We estimate conservatively that at least 1.3% of certificates were earned by CAMEO.•Among earners of 20 or more certificates, 25% have used the CAMEO strategy.•CAMEO represents one of many threats to the validity of MOOC certifications.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.compedu.2016.04.008</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0002-2423-1300</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0360-1315 |
ispartof | Computers and education, 2016-09, Vol.100, p.71-80 |
issn | 0360-1315 1873-782X |
language | eng |
recordid | cdi_proquest_miscellaneous_1825514897 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Architecture for educational technology system Assessments Certificates Cheating detection Computer assisted instruction Distance education Educational certification Educational Data Mining (EDM) Estimates Learning communities Lifelong learning Massive Open Online Courses (MOOCs) Online Pedagogical issues Reproduction Security Strategy Teaching/learning strategies |
title | Detecting and preventing “multiple-account” cheating in massive open online courses |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T08%3A41%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Detecting%20and%20preventing%20%E2%80%9Cmultiple-account%E2%80%9D%20cheating%20in%20massive%20open%20online%20courses&rft.jtitle=Computers%20and%20education&rft.au=Northcutt,%20Curtis%20G.&rft.date=2016-09&rft.volume=100&rft.spage=71&rft.epage=80&rft.pages=71-80&rft.issn=0360-1315&rft.eissn=1873-782X&rft_id=info:doi/10.1016/j.compedu.2016.04.008&rft_dat=%3Cproquest_cross%3E1825514897%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1825514897&rft_id=info:pmid/&rft_els_id=S0360131516300896&rfr_iscdi=true |