Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment
OBJECTIVE:To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills. METHODS:Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed u...
Gespeichert in:
| Veröffentlicht in: | Obstetrics and gynecology (New York. 1953) 2020-11, Vol.136 (5), p.942-949 |
|---|---|
| Hauptverfasser: | , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 949 |
|---|---|
| container_issue | 5 |
| container_start_page | 942 |
| container_title | Obstetrics and gynecology (New York. 1953) |
| container_volume | 136 |
| creator | Chen, Chi Chung Grace Lockrow, Ernest G. DeStephano, Christopher C. Nihira, Mikio A. Matthews, Catherine Kammire, Leslie Landrum, Lisa M. Anderson, Bruce D. Miyazaki, Douglas |
| description | OBJECTIVE:To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills.
METHODS:Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass–fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants.
RESULTS:Fifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P |
| doi_str_mv | 10.1097/AOG.0000000000004085 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7575024</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2449954998</sourcerecordid><originalsourceid>FETCH-LOGICAL-c5025-a25e4eab8f62b6f19324bb9276736e24ea258c641d5b613b4cb35c9b9043f1f33</originalsourceid><addsrcrecordid>eNqFkt9PFDEQxxuigRP5D4jZR18W-nO7fTG5EAQTDA8Hxrfa9rp3le4WO7uS--_teUDQB23SNJP5zHcm8y1CxwSfEKzk6fz64gS_OBy3Yg_NSCtZTRn7-grNMKaqli3nB-gNwPcCkUaxfXTAGGa4lXKGvp3DaGwMsA7DqvpiYliGcVN1KVemhKswmFhdbmD02bsx9ZtqEfopmjGkofqclj7-ZhdTXgVX0MVdiBGqOYAH6P0wvkWvOxPBHz2-h-j24_nN2WV9dX3x6Wx-VTuBqagNFZ57Y9uuobbpiGKUW6uobCRrPC0pKlrXcLIUtiHMcmeZcMoqzFlHOsYO0Yed7v1ke790pXU2Ud_n0Ju80ckE_WdmCGu9Sj-1FLJMwIvA-0eBnH5MHkbdB3A-RjP4NIGmnCslym0Lyneoywkg--65DcF6a44u5ui_zSll716O-Fz05EYB2h3wkGJZONzF6cFnvfYmjuv_afN_lG6xhgpcU0wxISWqt5-Bsl_BeqzL</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2449954998</pqid></control><display><type>article</type><title>Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment</title><source>MEDLINE</source><source>Journals@Ovid Ovid Autoload</source><creator>Chen, Chi Chung Grace ; Lockrow, Ernest G. ; DeStephano, Christopher C. ; Nihira, Mikio A. ; Matthews, Catherine ; Kammire, Leslie ; Landrum, Lisa M. ; Anderson, Bruce D. ; Miyazaki, Douglas</creator><creatorcontrib>Chen, Chi Chung Grace ; Lockrow, Ernest G. ; DeStephano, Christopher C. ; Nihira, Mikio A. ; Matthews, Catherine ; Kammire, Leslie ; Landrum, Lisa M. ; Anderson, Bruce D. ; Miyazaki, Douglas</creatorcontrib><description>OBJECTIVE:To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills.
METHODS:Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass–fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants.
RESULTS:Fifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P<.001; Pearson r=0.74, P<.001). Likewise, surgical experience was also moderately correlated with the modified Vaginal Surgical Skills Index and global scale score (Pearson r=0.55, P<.001; Pearson r=0.58, P<.001). The internal consistency of the modified Vaginal Surgical Skills Index was excellent (Cronbachʼs alpha=0.97). Interrater reliability of the modified Vaginal Surgical Skills Index and global scale score, as measured by the intraclass correlation coefficient, was moderate to good (0.49–0.95; 0.50–0.87). Using the receiver operating characteristic curve and the pass–fail criterion, a modified Vaginal Surgical Skills Index cutoff score of 27 was found to most accurately (area under the curve 0.951, 95% CI 0.917–0.983) differentiate competent from noncompetent surgeons.
CONCLUSION:We demonstrated validity evidence for using a high-fidelity vaginal surgery model with the modified Vaginal Surgical Skills Index or global scale score to assess vaginal hysterectomy skills.</description><identifier>ISSN: 0029-7844</identifier><identifier>ISSN: 1873-233X</identifier><identifier>EISSN: 1873-233X</identifier><identifier>DOI: 10.1097/AOG.0000000000004085</identifier><identifier>PMID: 33030877</identifier><language>eng</language><publisher>United States: Lippincott Williams & Wilkins</publisher><subject>Adult ; Clinical Competence - statistics & numerical data ; Contents ; Educational Measurement - standards ; Female ; Gynecology - education ; Humans ; Hysterectomy, Vaginal - education ; Obstetrics - education ; Original Research ; Reproducibility of Results ; Simulation Training ; Surgeons - education ; Surgeons - statistics & numerical data</subject><ispartof>Obstetrics and gynecology (New York. 1953), 2020-11, Vol.136 (5), p.942-949</ispartof><rights>Lippincott Williams & Wilkins</rights><rights>2020 by The American College of Obstetricians and Gynecologists. Published by Wolters Kluwer Health, Inc. All rights reserved.</rights><rights>2020 The Author(s). Published by Wolters Kluwer Health, Inc. 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c5025-a25e4eab8f62b6f19324bb9276736e24ea258c641d5b613b4cb35c9b9043f1f33</citedby><cites>FETCH-LOGICAL-c5025-a25e4eab8f62b6f19324bb9276736e24ea258c641d5b613b4cb35c9b9043f1f33</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,776,780,881,27903,27904</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33030877$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chen, Chi Chung Grace</creatorcontrib><creatorcontrib>Lockrow, Ernest G.</creatorcontrib><creatorcontrib>DeStephano, Christopher C.</creatorcontrib><creatorcontrib>Nihira, Mikio A.</creatorcontrib><creatorcontrib>Matthews, Catherine</creatorcontrib><creatorcontrib>Kammire, Leslie</creatorcontrib><creatorcontrib>Landrum, Lisa M.</creatorcontrib><creatorcontrib>Anderson, Bruce D.</creatorcontrib><creatorcontrib>Miyazaki, Douglas</creatorcontrib><title>Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment</title><title>Obstetrics and gynecology (New York. 1953)</title><addtitle>Obstet Gynecol</addtitle><description>OBJECTIVE:To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills.
METHODS:Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass–fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants.
RESULTS:Fifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P<.001; Pearson r=0.74, P<.001). Likewise, surgical experience was also moderately correlated with the modified Vaginal Surgical Skills Index and global scale score (Pearson r=0.55, P<.001; Pearson r=0.58, P<.001). The internal consistency of the modified Vaginal Surgical Skills Index was excellent (Cronbachʼs alpha=0.97). Interrater reliability of the modified Vaginal Surgical Skills Index and global scale score, as measured by the intraclass correlation coefficient, was moderate to good (0.49–0.95; 0.50–0.87). Using the receiver operating characteristic curve and the pass–fail criterion, a modified Vaginal Surgical Skills Index cutoff score of 27 was found to most accurately (area under the curve 0.951, 95% CI 0.917–0.983) differentiate competent from noncompetent surgeons.
CONCLUSION:We demonstrated validity evidence for using a high-fidelity vaginal surgery model with the modified Vaginal Surgical Skills Index or global scale score to assess vaginal hysterectomy skills.</description><subject>Adult</subject><subject>Clinical Competence - statistics & numerical data</subject><subject>Contents</subject><subject>Educational Measurement - standards</subject><subject>Female</subject><subject>Gynecology - education</subject><subject>Humans</subject><subject>Hysterectomy, Vaginal - education</subject><subject>Obstetrics - education</subject><subject>Original Research</subject><subject>Reproducibility of Results</subject><subject>Simulation Training</subject><subject>Surgeons - education</subject><subject>Surgeons - statistics & numerical data</subject><issn>0029-7844</issn><issn>1873-233X</issn><issn>1873-233X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkt9PFDEQxxuigRP5D4jZR18W-nO7fTG5EAQTDA8Hxrfa9rp3le4WO7uS--_teUDQB23SNJP5zHcm8y1CxwSfEKzk6fz64gS_OBy3Yg_NSCtZTRn7-grNMKaqli3nB-gNwPcCkUaxfXTAGGa4lXKGvp3DaGwMsA7DqvpiYliGcVN1KVemhKswmFhdbmD02bsx9ZtqEfopmjGkofqclj7-ZhdTXgVX0MVdiBGqOYAH6P0wvkWvOxPBHz2-h-j24_nN2WV9dX3x6Wx-VTuBqagNFZ57Y9uuobbpiGKUW6uobCRrPC0pKlrXcLIUtiHMcmeZcMoqzFlHOsYO0Yed7v1ke790pXU2Ud_n0Ju80ckE_WdmCGu9Sj-1FLJMwIvA-0eBnH5MHkbdB3A-RjP4NIGmnCslym0Lyneoywkg--65DcF6a44u5ui_zSll716O-Fz05EYB2h3wkGJZONzF6cFnvfYmjuv_afN_lG6xhgpcU0wxISWqt5-Bsl_BeqzL</recordid><startdate>202011</startdate><enddate>202011</enddate><creator>Chen, Chi Chung Grace</creator><creator>Lockrow, Ernest G.</creator><creator>DeStephano, Christopher C.</creator><creator>Nihira, Mikio A.</creator><creator>Matthews, Catherine</creator><creator>Kammire, Leslie</creator><creator>Landrum, Lisa M.</creator><creator>Anderson, Bruce D.</creator><creator>Miyazaki, Douglas</creator><general>Lippincott Williams & Wilkins</general><general>by The American College of Obstetricians and Gynecologists. Published by Wolters Kluwer Health, Inc. All rights reserved</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>202011</creationdate><title>Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment</title><author>Chen, Chi Chung Grace ; Lockrow, Ernest G. ; DeStephano, Christopher C. ; Nihira, Mikio A. ; Matthews, Catherine ; Kammire, Leslie ; Landrum, Lisa M. ; Anderson, Bruce D. ; Miyazaki, Douglas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c5025-a25e4eab8f62b6f19324bb9276736e24ea258c641d5b613b4cb35c9b9043f1f33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Adult</topic><topic>Clinical Competence - statistics & numerical data</topic><topic>Contents</topic><topic>Educational Measurement - standards</topic><topic>Female</topic><topic>Gynecology - education</topic><topic>Humans</topic><topic>Hysterectomy, Vaginal - education</topic><topic>Obstetrics - education</topic><topic>Original Research</topic><topic>Reproducibility of Results</topic><topic>Simulation Training</topic><topic>Surgeons - education</topic><topic>Surgeons - statistics & numerical data</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Chi Chung Grace</creatorcontrib><creatorcontrib>Lockrow, Ernest G.</creatorcontrib><creatorcontrib>DeStephano, Christopher C.</creatorcontrib><creatorcontrib>Nihira, Mikio A.</creatorcontrib><creatorcontrib>Matthews, Catherine</creatorcontrib><creatorcontrib>Kammire, Leslie</creatorcontrib><creatorcontrib>Landrum, Lisa M.</creatorcontrib><creatorcontrib>Anderson, Bruce D.</creatorcontrib><creatorcontrib>Miyazaki, Douglas</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Obstetrics and gynecology (New York. 1953)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Chi Chung Grace</au><au>Lockrow, Ernest G.</au><au>DeStephano, Christopher C.</au><au>Nihira, Mikio A.</au><au>Matthews, Catherine</au><au>Kammire, Leslie</au><au>Landrum, Lisa M.</au><au>Anderson, Bruce D.</au><au>Miyazaki, Douglas</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment</atitle><jtitle>Obstetrics and gynecology (New York. 1953)</jtitle><addtitle>Obstet Gynecol</addtitle><date>2020-11</date><risdate>2020</risdate><volume>136</volume><issue>5</issue><spage>942</spage><epage>949</epage><pages>942-949</pages><issn>0029-7844</issn><issn>1873-233X</issn><eissn>1873-233X</eissn><abstract>OBJECTIVE:To use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills.
METHODS:Video recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass–fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants.
RESULTS:Fifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P<.001; Pearson r=0.74, P<.001). Likewise, surgical experience was also moderately correlated with the modified Vaginal Surgical Skills Index and global scale score (Pearson r=0.55, P<.001; Pearson r=0.58, P<.001). The internal consistency of the modified Vaginal Surgical Skills Index was excellent (Cronbachʼs alpha=0.97). Interrater reliability of the modified Vaginal Surgical Skills Index and global scale score, as measured by the intraclass correlation coefficient, was moderate to good (0.49–0.95; 0.50–0.87). Using the receiver operating characteristic curve and the pass–fail criterion, a modified Vaginal Surgical Skills Index cutoff score of 27 was found to most accurately (area under the curve 0.951, 95% CI 0.917–0.983) differentiate competent from noncompetent surgeons.
CONCLUSION:We demonstrated validity evidence for using a high-fidelity vaginal surgery model with the modified Vaginal Surgical Skills Index or global scale score to assess vaginal hysterectomy skills.</abstract><cop>United States</cop><pub>Lippincott Williams & Wilkins</pub><pmid>33030877</pmid><doi>10.1097/AOG.0000000000004085</doi><tpages>8</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0029-7844 |
| ispartof | Obstetrics and gynecology (New York. 1953), 2020-11, Vol.136 (5), p.942-949 |
| issn | 0029-7844 1873-233X 1873-233X |
| language | eng |
| recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7575024 |
| source | MEDLINE; Journals@Ovid Ovid Autoload |
| subjects | Adult Clinical Competence - statistics & numerical data Contents Educational Measurement - standards Female Gynecology - education Humans Hysterectomy, Vaginal - education Obstetrics - education Original Research Reproducibility of Results Simulation Training Surgeons - education Surgeons - statistics & numerical data |
| title | Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T16%3A52%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Establishing%20Validity%20for%20a%20Vaginal%20Hysterectomy%20Simulation%20Model%20for%20Surgical%20Skills%20Assessment&rft.jtitle=Obstetrics%20and%20gynecology%20(New%20York.%201953)&rft.au=Chen,%20Chi%20Chung%20Grace&rft.date=2020-11&rft.volume=136&rft.issue=5&rft.spage=942&rft.epage=949&rft.pages=942-949&rft.issn=0029-7844&rft.eissn=1873-233X&rft_id=info:doi/10.1097/AOG.0000000000004085&rft_dat=%3Cproquest_pubme%3E2449954998%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2449954998&rft_id=info:pmid/33030877&rfr_iscdi=true |