Measuring the Effectiveness of In-School CVE Intervention Programs: Scope and Evaluation Methods

This presentation outlines the results of the primary programmatic evaluation efforts the Emergency Preparedness Research Evaluation and Practice (EPREP) Program has conducted since 2016. The presentation begins with an overview of the methodology of selecting outcome measures to evaluate program efficacy, as well as a description of the evaluation framework. Results of the longitudinal and quasi-experimental 2017 evaluation of the Online4Good Academy—on of the training events at the focus of the Boston CVE Pilot Program—are presented and discussed. In 2018, the EPREP Program utilized a longitudinal and quasi-experimental design to evaluate the efficacy of the Peer2Peer antihatred campaign Kombat with Kindness. Results and implications from this study are discussed. The final portion of the presentation describes the more recent activities of the EPREP Program—an evaluation of the online safety program Operation 250 (OP250). This portion of the lecture describes the psychological framework and theory of change under which OP250 implements their initiative. During the final segment we also present the preliminary results of a randomized controlled trial conducted at two different study sites in Massachusetts designed to evaluate the programs’ efficacy.