Comparing Resident Self-Report to Chart Audits for Quality Improvement Projects: Accurate Reflection or Cherry-Picking?

Resident engagement in quality improvement is a requirement for graduate medical education, but the optimal means of instruction and evaluation of resident progress remain unknown. To determine the accuracy of self-reported chart audits in measuring resident adherence to primary care clinical practice guidelines. During the 2010-2011 academic year, second- and third-year internal medicine residents at a single, university hospital-based program performed chart audits on 10 patients from their primary care clinic to determine adherence to 16 US Preventive Services Task Force primary care guidelines. We compared residents' responses to independent audits of randomly selected patient charts by a single external reviewer. Self-reported data were collected by 18 second-year and 15 third-year residents for 330 patients. Independently, 70 patient charts were randomly selected for review by an external auditor. Overall guideline compliance was significantly higher on self-reported audits compared to external audits (82% versus 68%, P