That’s Incorrect and Let Me Tell You Why: A Scalable Assessment to Evaluate Higher Order Thinking Skills

We introduce a novel type of assessment that allows for efficient grading of higher order thinking skills. In this assessment, a student reviews and corrects a technical memo that has errors in its formulation or process. To overcome the grading challenges imposed by essay-type responses in large undergraduate courses, we provide a Visual Basic for Applications Excel tool for instructors, ensuring efficient grading of student submissions. We report our experience using this type of assessment in a multisection introductory business analytics course over several years and present survey-based evidence indicating that students perceive it to be clear and beneficial for learning. Supplemental Material: Data is available at https://www.informs.org/Publications/Subscribe/Access-Restricted-Materials