The Lake Wobegon effect is real: All general surgery residents appear to be better than average

•Percentile ranking of residents by faculty is extremely skewed to the right.•Subjective faculty evaluations correlate with objective standardized exam scores in junior but not upper-level residents.•Faculty tend to rank residents above average; the inclusion of objective standardized scores in dete...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Surgery in practice and science 2022-12, Vol.11, p.100134, Article 100134
Hauptverfasser: Yamashita, Thomas Szabo, Yeh, Vicky J.H., Lund, Sarah, Rivera, Mariela, McKenzie, Travis J., Stulak, John M., Heller, Stephanie F., Jakub, James W.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•Percentile ranking of residents by faculty is extremely skewed to the right.•Subjective faculty evaluations correlate with objective standardized exam scores in junior but not upper-level residents.•Faculty tend to rank residents above average; the inclusion of objective standardized scores in determining resident progression remain useful. Resident evaluations remain controversial. Metric systems are employed to objectify evaluations. Our institution adopted the question “Relative to all other trainees that I have supervised over my career, I place this individual's performance in the following percentile” with the goal of objectifying the evaluations. We report the distribution and the correlation of this value to other evaluation parameters. Retrospective single-institution review of general surgery resident evaluations (2008–2020). Demographic characteristics, level of training and internal evaluation variables were collected. Percentile distribution and association between subjective and objective measures were analyzed. 3117 evaluations (116 residents) were reviewed. 96% had the percentile question answered. Faculty ranked 68% of residents at or above 80th percentile. Faculty subjective evaluation on residents’ overall performance and technical skills correlate with resident objective assessment scores in PGY-1 and -2 but not in PGY-3 to PGY-5. Rank failed to produce a bell-shaped curve, remaining right-skewed; indicating grade inflation. The lack of association between variables indicates that both assessments remain useful for residency programs. Work is needed to benchmark evaluations, ensuring proper feedback about performance.
ISSN:2666-2620
2666-2620
DOI:10.1016/j.sipas.2022.100134