The development, implementation, and evaluation of a pre-rotation quiz to improve resident preparedness for an abdominal wall reconstruction surgical rotation

Introduction Although hernia repair constitutes a significant portion of surgical training, education around more complex hernia concepts such as abdominal wall reconstruction (AWR) or paraesophageal hernia repair may be lacking. We developed and implemented a pre-rotation quiz for residents on an AWR and minimally invasive surgery service. We also investigated the staff and resident perception of resident knowledge and experience of the rotation before and after quiz implementation. Methods The multiple-choice quiz questions were written by clinical and research fellows, validated by four staff, two fellows, and two senior residents and implemented in June 2023. Questions assessed knowledge of anatomy, operative steps, mesh materials, clinical trials, and postoperative management specific to ventral, inguinal, and paraesophageal hernia repairs. Residents were notified of the summative quiz three weeks prior and provided with reference materials specific to quiz questions. Anonymous Likert-type surveys were distributed to staff and residents between 3/2023 and 3/2024. Responses were assessed based on the overall score as well as individual domains and then compared based on whether they were completed before or after implementation of the quiz. Results 17 seniors and 29 juniors rotated on service and all completed the pre-rotation quiz between 7/1/2023-3/4/2024. The mean first attempt score was 72%(± 12.4%) for junior residents and 88.4%(± 9.6%) for senior residents. Staff reported overall resident knowledge improved after quiz implementation (maximum 90, mean(SD): 46.25(± 8.58) vs. 75.5(± 11.24), p = 0.05). Sixteen(45.7%) residents responded to the survey before quiz implementation and 23(50%) after. Residents only reported improved knowledge regarding current literature (maximum 5, mean(SD):3.2 ± 0.98 vs. 3.8 ± 0.78, p = 0.04). Conclusion Implementing a pre-rotation quiz effectively improves staff perception of resident knowledge and preparation.