Learning management systems: technology to measure the medical knowledge competency of the ACGME

Aims We report how the learning management system (LMS) Web Course Tools (WebCT) was used to design, implement and evaluate the web‐based course ‘Principles of Ambulatory Paediatrics’, taken by paediatric residents during an ambulatory block rotation. This report also illustrates how WebCT can be used to measure the medical knowledge competency required by the Accreditation Council for Graduate Medical Education (ACGME). Methods Eighty paediatric residents completed a 1‐month outpatient rotation between July 1, 2001 and June 30, 2002. During this rotation residents were required to complete 4 modules in asthma, otitis media, gastroenteritis and fever, respectively. Each module was evaluated using a standard questionnaire. Results Completion rates for the required modules ranged from 64−72%. Residents in all 3 years of training showed improvement between the pre‐ and post‐test scores for each module, except for postgraduate Year 2 residents in the asthma module. Most residents somewhat agreed, agreed or strongly agreed that the module components were useful and that the experience of completing the modules would improve their ability to take care of patients. Conclusions The LMS WebCT is an innovative and adaptable approach for designing a web‐based course for primary care education in paediatrics. The LMS addresses the educational needs of both a clinical division and a residency programme. The LMS also provides an information technology infrastructure to measure the medical knowledge competency required by the ACGME.