Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year
This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity. Attending ratings for residents were obtained from System for Improving and Measuring...
Gespeichert in:
Veröffentlicht in: | Journal of surgical education 2021-11, Vol.78 (6), p.e47-e55 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | e55 |
---|---|
container_issue | 6 |
container_start_page | e47 |
container_title | Journal of surgical education |
container_volume | 78 |
creator | Booth, Kristina K. Stewart, Kenneth E. Lewis, Samara L. Garwe, Tabitha Kempenich, Jason W. Lees, Jason S. |
description | This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity.
Attending ratings for residents were obtained from System for Improving and Measuring Procedural Learning (SIMPL) database. Current procedural terminology (CPT) codes were used to match procedures to a corresponding work relative value unit (wRVU) as a surrogate for procedure difficulty. Three categories of wRVU (22) were identified using recursive partitioning. Procedures were also divided into ‘Core’ or ‘Advanced’ as defined by the American Board of Surgery Surgical Council on Resident Education (SCORE). Temporal advancement in resident skill was accounted for through academic quarterly analysis. A generalized estimating equations (GEE) approach was used to form separate multivariable logistic regression models for meaningful autonomy (MA) and satisfactory performance (SP) adjusted for potential clustering by program, subject, and rater. Models were further adjusted for core/advanced procedures, attending rated complexity, and academic quarter.
A total of 33,281 ratings were analyzed. Overall, 51.6% were rated as MA and 44.4% as SP. For core procedures, surgical residents rated as MA (53.5%) and SP (45.7%), which was twice as high as those for advance procedures (MA-29.2%, SP-29.0%). MA and SP both decreased with increasing wRVU (Figure 2 &3). Using a wRVU22.00 (Table 3). Post graduate year (PGY) 5 residents in the final quarter of training obtain MA in 95.5% and SP 92.9% for core procedures with wRVU |
doi_str_mv | 10.1016/j.jsurg.2021.08.002 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2573436560</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1931720421002026</els_id><sourcerecordid>2573436560</sourcerecordid><originalsourceid>FETCH-LOGICAL-c359t-11cd9561128fbcccc766b26da6c01419488e26b31ed237b63dfd1ba839ab52bb3</originalsourceid><addsrcrecordid>eNp9kctu1DAUhiMEohd4AiTkJZsEXxInWbBAU2grVWLUlgUry5eTwaMkHo6donkHHhoPU7qsF_ax_J3_l89fFO8YrRhl8uO22sYFNxWnnFW0qyjlL4pT1rVd2dYNf5nrXrCy5bQ-Kc5i3FLa1D3vXxcnIr9L3sjT4s8qIMKokw8zCQO5W3aADz6CI9ezgx3kbbZA9OzIGnAIOOnD_bdPP8kagwW3IJALPwzeLmPaEz2FeRNTVsKNt3oktxB9FkmR3CXMRoPP4mZP1iFTl6jdohOQH6DxTfFq0GOEt4_nefH965f71VV58-3yevX5prSi6VPJmHV9Ixnj3WBsXq2UhkunpaWsZn3ddcClEQwcF62Rwg2OGd2JXpuGGyPOiw9H3R2GXwvEpCYfLYyjniEsUfGmFbWQjaQZFUfUYogRYVA79JPGvWJUHWJQW_UvBnWIQdFO5Rhy1_tHg8VM4J56_s89A5-OAORvPnhAFa0_DNp5BJuUC_5Zg7_57p1Z</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2573436560</pqid></control><display><type>article</type><title>Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Booth, Kristina K. ; Stewart, Kenneth E. ; Lewis, Samara L. ; Garwe, Tabitha ; Kempenich, Jason W. ; Lees, Jason S.</creator><creatorcontrib>Booth, Kristina K. ; Stewart, Kenneth E. ; Lewis, Samara L. ; Garwe, Tabitha ; Kempenich, Jason W. ; Lees, Jason S.</creatorcontrib><description>This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity.
Attending ratings for residents were obtained from System for Improving and Measuring Procedural Learning (SIMPL) database. Current procedural terminology (CPT) codes were used to match procedures to a corresponding work relative value unit (wRVU) as a surrogate for procedure difficulty. Three categories of wRVU (<13.07, 13.07-22, >22) were identified using recursive partitioning. Procedures were also divided into ‘Core’ or ‘Advanced’ as defined by the American Board of Surgery Surgical Council on Resident Education (SCORE). Temporal advancement in resident skill was accounted for through academic quarterly analysis. A generalized estimating equations (GEE) approach was used to form separate multivariable logistic regression models for meaningful autonomy (MA) and satisfactory performance (SP) adjusted for potential clustering by program, subject, and rater. Models were further adjusted for core/advanced procedures, attending rated complexity, and academic quarter.
A total of 33,281 ratings were analyzed. Overall, 51.6% were rated as MA and 44.4% as SP. For core procedures, surgical residents rated as MA (53.5%) and SP (45.7%), which was twice as high as those for advance procedures (MA-29.2%, SP-29.0%). MA and SP both decreased with increasing wRVU (Figure 2 &3). Using a wRVU<13.07 as a reference, the adjusted odds ratios of MA and SP were significantly lower with increasing procedure difficulty, 0.44 for wRVU 13.07-22.0 and 0.24 for wRVU >22.00 (Table 3). Post graduate year (PGY) 5 residents in the final quarter of training obtain MA in 95.5% and SP 92.9% for core procedures with wRVU <13.07 (Table 4).
Increasing procedural difficulty is independently associated with decreases in meaningful autonomy and satisfactory performance. As residents approach graduation the level of meaningful autonomy and satisfactory performance both reach high levels for common core procedures but decrease as procedural difficulty increases.</description><identifier>ISSN: 1931-7204</identifier><identifier>EISSN: 1878-7452</identifier><identifier>DOI: 10.1016/j.jsurg.2021.08.002</identifier><identifier>PMID: 34526256</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Clinical Competence ; Current Procedural Terminology ; General Surgery - education ; Internship and Residency ; procedure difficulty ; Readiness for graduation ; Resident autonomy ; Resident performance ; Resident supervision ; System for Improving and Measuring Procedural Learning (SIMPL)</subject><ispartof>Journal of surgical education, 2021-11, Vol.78 (6), p.e47-e55</ispartof><rights>2021 Association of Program Directors in Surgery</rights><rights>Copyright © 2021 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c359t-11cd9561128fbcccc766b26da6c01419488e26b31ed237b63dfd1ba839ab52bb3</citedby><cites>FETCH-LOGICAL-c359t-11cd9561128fbcccc766b26da6c01419488e26b31ed237b63dfd1ba839ab52bb3</cites><orcidid>0000-0002-8347-2569 ; 0000-0002-3558-4574</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S1931720421002026$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34526256$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Booth, Kristina K.</creatorcontrib><creatorcontrib>Stewart, Kenneth E.</creatorcontrib><creatorcontrib>Lewis, Samara L.</creatorcontrib><creatorcontrib>Garwe, Tabitha</creatorcontrib><creatorcontrib>Kempenich, Jason W.</creatorcontrib><creatorcontrib>Lees, Jason S.</creatorcontrib><title>Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year</title><title>Journal of surgical education</title><addtitle>J Surg Educ</addtitle><description>This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity.
Attending ratings for residents were obtained from System for Improving and Measuring Procedural Learning (SIMPL) database. Current procedural terminology (CPT) codes were used to match procedures to a corresponding work relative value unit (wRVU) as a surrogate for procedure difficulty. Three categories of wRVU (<13.07, 13.07-22, >22) were identified using recursive partitioning. Procedures were also divided into ‘Core’ or ‘Advanced’ as defined by the American Board of Surgery Surgical Council on Resident Education (SCORE). Temporal advancement in resident skill was accounted for through academic quarterly analysis. A generalized estimating equations (GEE) approach was used to form separate multivariable logistic regression models for meaningful autonomy (MA) and satisfactory performance (SP) adjusted for potential clustering by program, subject, and rater. Models were further adjusted for core/advanced procedures, attending rated complexity, and academic quarter.
A total of 33,281 ratings were analyzed. Overall, 51.6% were rated as MA and 44.4% as SP. For core procedures, surgical residents rated as MA (53.5%) and SP (45.7%), which was twice as high as those for advance procedures (MA-29.2%, SP-29.0%). MA and SP both decreased with increasing wRVU (Figure 2 &3). Using a wRVU<13.07 as a reference, the adjusted odds ratios of MA and SP were significantly lower with increasing procedure difficulty, 0.44 for wRVU 13.07-22.0 and 0.24 for wRVU >22.00 (Table 3). Post graduate year (PGY) 5 residents in the final quarter of training obtain MA in 95.5% and SP 92.9% for core procedures with wRVU <13.07 (Table 4).
Increasing procedural difficulty is independently associated with decreases in meaningful autonomy and satisfactory performance. As residents approach graduation the level of meaningful autonomy and satisfactory performance both reach high levels for common core procedures but decrease as procedural difficulty increases.</description><subject>Clinical Competence</subject><subject>Current Procedural Terminology</subject><subject>General Surgery - education</subject><subject>Internship and Residency</subject><subject>procedure difficulty</subject><subject>Readiness for graduation</subject><subject>Resident autonomy</subject><subject>Resident performance</subject><subject>Resident supervision</subject><subject>System for Improving and Measuring Procedural Learning (SIMPL)</subject><issn>1931-7204</issn><issn>1878-7452</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kctu1DAUhiMEohd4AiTkJZsEXxInWbBAU2grVWLUlgUry5eTwaMkHo6donkHHhoPU7qsF_ax_J3_l89fFO8YrRhl8uO22sYFNxWnnFW0qyjlL4pT1rVd2dYNf5nrXrCy5bQ-Kc5i3FLa1D3vXxcnIr9L3sjT4s8qIMKokw8zCQO5W3aADz6CI9ezgx3kbbZA9OzIGnAIOOnD_bdPP8kagwW3IJALPwzeLmPaEz2FeRNTVsKNt3oktxB9FkmR3CXMRoPP4mZP1iFTl6jdohOQH6DxTfFq0GOEt4_nefH965f71VV58-3yevX5prSi6VPJmHV9Ixnj3WBsXq2UhkunpaWsZn3ddcClEQwcF62Rwg2OGd2JXpuGGyPOiw9H3R2GXwvEpCYfLYyjniEsUfGmFbWQjaQZFUfUYogRYVA79JPGvWJUHWJQW_UvBnWIQdFO5Rhy1_tHg8VM4J56_s89A5-OAORvPnhAFa0_DNp5BJuUC_5Zg7_57p1Z</recordid><startdate>202111</startdate><enddate>202111</enddate><creator>Booth, Kristina K.</creator><creator>Stewart, Kenneth E.</creator><creator>Lewis, Samara L.</creator><creator>Garwe, Tabitha</creator><creator>Kempenich, Jason W.</creator><creator>Lees, Jason S.</creator><general>Elsevier Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8347-2569</orcidid><orcidid>https://orcid.org/0000-0002-3558-4574</orcidid></search><sort><creationdate>202111</creationdate><title>Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year</title><author>Booth, Kristina K. ; Stewart, Kenneth E. ; Lewis, Samara L. ; Garwe, Tabitha ; Kempenich, Jason W. ; Lees, Jason S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c359t-11cd9561128fbcccc766b26da6c01419488e26b31ed237b63dfd1ba839ab52bb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Clinical Competence</topic><topic>Current Procedural Terminology</topic><topic>General Surgery - education</topic><topic>Internship and Residency</topic><topic>procedure difficulty</topic><topic>Readiness for graduation</topic><topic>Resident autonomy</topic><topic>Resident performance</topic><topic>Resident supervision</topic><topic>System for Improving and Measuring Procedural Learning (SIMPL)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Booth, Kristina K.</creatorcontrib><creatorcontrib>Stewart, Kenneth E.</creatorcontrib><creatorcontrib>Lewis, Samara L.</creatorcontrib><creatorcontrib>Garwe, Tabitha</creatorcontrib><creatorcontrib>Kempenich, Jason W.</creatorcontrib><creatorcontrib>Lees, Jason S.</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of surgical education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Booth, Kristina K.</au><au>Stewart, Kenneth E.</au><au>Lewis, Samara L.</au><au>Garwe, Tabitha</au><au>Kempenich, Jason W.</au><au>Lees, Jason S.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year</atitle><jtitle>Journal of surgical education</jtitle><addtitle>J Surg Educ</addtitle><date>2021-11</date><risdate>2021</risdate><volume>78</volume><issue>6</issue><spage>e47</spage><epage>e55</epage><pages>e47-e55</pages><issn>1931-7204</issn><eissn>1878-7452</eissn><abstract>This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity.
Attending ratings for residents were obtained from System for Improving and Measuring Procedural Learning (SIMPL) database. Current procedural terminology (CPT) codes were used to match procedures to a corresponding work relative value unit (wRVU) as a surrogate for procedure difficulty. Three categories of wRVU (<13.07, 13.07-22, >22) were identified using recursive partitioning. Procedures were also divided into ‘Core’ or ‘Advanced’ as defined by the American Board of Surgery Surgical Council on Resident Education (SCORE). Temporal advancement in resident skill was accounted for through academic quarterly analysis. A generalized estimating equations (GEE) approach was used to form separate multivariable logistic regression models for meaningful autonomy (MA) and satisfactory performance (SP) adjusted for potential clustering by program, subject, and rater. Models were further adjusted for core/advanced procedures, attending rated complexity, and academic quarter.
A total of 33,281 ratings were analyzed. Overall, 51.6% were rated as MA and 44.4% as SP. For core procedures, surgical residents rated as MA (53.5%) and SP (45.7%), which was twice as high as those for advance procedures (MA-29.2%, SP-29.0%). MA and SP both decreased with increasing wRVU (Figure 2 &3). Using a wRVU<13.07 as a reference, the adjusted odds ratios of MA and SP were significantly lower with increasing procedure difficulty, 0.44 for wRVU 13.07-22.0 and 0.24 for wRVU >22.00 (Table 3). Post graduate year (PGY) 5 residents in the final quarter of training obtain MA in 95.5% and SP 92.9% for core procedures with wRVU <13.07 (Table 4).
Increasing procedural difficulty is independently associated with decreases in meaningful autonomy and satisfactory performance. As residents approach graduation the level of meaningful autonomy and satisfactory performance both reach high levels for common core procedures but decrease as procedural difficulty increases.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>34526256</pmid><doi>10.1016/j.jsurg.2021.08.002</doi><orcidid>https://orcid.org/0000-0002-8347-2569</orcidid><orcidid>https://orcid.org/0000-0002-3558-4574</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1931-7204 |
ispartof | Journal of surgical education, 2021-11, Vol.78 (6), p.e47-e55 |
issn | 1931-7204 1878-7452 |
language | eng |
recordid | cdi_proquest_miscellaneous_2573436560 |
source | MEDLINE; Elsevier ScienceDirect Journals |
subjects | Clinical Competence Current Procedural Terminology General Surgery - education Internship and Residency procedure difficulty Readiness for graduation Resident autonomy Resident performance Resident supervision System for Improving and Measuring Procedural Learning (SIMPL) |
title | Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T10%3A28%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Correlation%20of%20Supervised%20Independence%20and%20Performance%20with%20Procedure%20Difficulty%20amongst%20Surgical%20Residents%20Stratified%20by%20Post%20Graduate%20Year&rft.jtitle=Journal%20of%20surgical%20education&rft.au=Booth,%20Kristina%20K.&rft.date=2021-11&rft.volume=78&rft.issue=6&rft.spage=e47&rft.epage=e55&rft.pages=e47-e55&rft.issn=1931-7204&rft.eissn=1878-7452&rft_id=info:doi/10.1016/j.jsurg.2021.08.002&rft_dat=%3Cproquest_cross%3E2573436560%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2573436560&rft_id=info:pmid/34526256&rft_els_id=S1931720421002026&rfr_iscdi=true |