A pilot survey study to define quality in residency education

To begin to define indicators of quality in internal medicine residency training. In 1995, through a modified Delphi process, the Association of Program Directors in Internal Medicine's Research Committee developed a questionnaire containing 44 items (34 process and ten outcome indicators). The survey was mailed to all 418 internal medicine program directors and a convenience sample of medical residents. Responding at a rate of 78% (326), program directors rated several indicators as important. These included such faculty characteristics as stability, completeness, supervision, clinical skills, and teaching commitment; institutional support; amount of resident evaluation and feedback; encouragement of lifelong learning; and ability to meet its program goals. There was strong agreement between faculty and residents (r = 0.91). Items rated less important included graduates' selecting academic or generalist careers, residents' caring for elective cardiac catheterization patients, resident community service, training minorities and women, and faculty research. These results demonstrate the diversity of opinion of what defines quality in residency education and the emphasis placed on process rather than outcome indicators. To be valid, future endeavors must include all those with a stake in graduate medical education, including accrediting bodies, future employers, and patients.