Measuring the ability of residents to manage oncologic problems

Background An OSCE was used to measure the ability of a cohort of residents to manage oncologic problems. Methods Nine oncologic clinical problems were presented to 56 surgical residents. Each problem contained a 5‐minute data‐gathering period (DGP) and a 5‐minute data‐interpretation period (DIP). A performance score was determined for each resident for each problem. Reliability was estimated by coefficient α; validity, by the construct of experience. Wilks's λ criterion was used to determine whether training level could be identified by OSCE performance. Results The DGP reliability was 0.80; the DIP, 0.49. Senior residents performed significantly better than junior residents (P = 0.0001), who performed significantly better than interns (P = 0.0009). Of the residents, 62% were competent on the DGP, but only 21% on the DIP. Important deficits in knowledge and clinical skills were apparent at all levels of training. Conclusion The education and evaluation of residents in oncology need improvement. J. Surg. Oncol. 64:135–142. © 1997 Wiley‐Liss, Inc.