A General Purpose Anomaly-based Method for Detecting Cheaters in Online Courses

This paper presents a general-purpose method for detecting cheating in online courses, which combines anomaly detection and supervised machine learning. Using features that are rooted in Psychometrics and Learning Analytics literature, and capture anomalies in learner behavior and response patterns, we demonstrate that a classifier that is trained on labeled data of users who performed a certain type of cheating (Copying Using Multiple Accounts) can detect users who performed a different type of cheating (unauthorized collaboration), as well as to detect cheaters in different contexts - future runs of the same course and another course that is on a different subject matter. This exploits the fact that we have dedicated algorithms for detecting these two methods of cheating, which enable us to compute ground truth labels on real student interaction data, and then use these labeled data to validate the proposed general-purpose algorithm. The empirical setting is based on five runs of two MITx MOOCs in Physics and Biology from 2014-16. The main contribution of this paper is twofold: First, proposing, for the first time, a general method for detecting cheating in online courses. Second, providing a validation that is based on real cheating data, as opposed to previous research on cheating detection, that with the absence of ground truth, relied on either simulations or indirect measures.