Informatics in radiology: evaluation of an e-learning platform for teaching medical students competency in ordering radiologic examinations

A preliminary audit of orders for computed tomography was performed to evaluate the typical performance of interns ordering radiologic examinations. According to the audit, the interns showed only minimal improvement after 8 months of work experience. The online radiology ordering module (ROM) program included baseline assessment of student performance (part I), online learning with the ROM (part II), and follow-up assessment of performance with simulated ordering with the ROM (part III). A curriculum blueprint determined the content of the ROM program, with an emphasis on practical issues, including provision of logistic information, clinical details, and safety-related information. Appropriate standards were developed by a committee of experts, and detailed scoring systems were devised for assessment. The ROM program was successful in addressing practical issues in a simulated setting. In the part I assessment, the mean score for noting contraindications for contrast media was 24%; this score increased to 59% in the part III assessment (P = .004). Similarly, notification of methicillin-resistant Staphylococcus aureus status and pregnancy status and provision of referring physician contact information improved significantly. The quality of the clinical notes was stable, with good initial scores. Part III testing showed overall improvement, with the mean score increasing from 61% to 76% (P < .0001). In general, medical students lack the core knowledge that is needed for good-quality ordering of radiology services, and the experience typically afforded to interns does not address this lack of knowledge. The ROM program was a successful intervention that resulted in statistically significant improvements in the quality of radiologic examination orders, particularly with regard to logistic and radiation safety issues.