Objective assessment of surgical skill transfer using non-invasive brain imaging
Background Physical and virtual surgical simulators are increasingly being used in training technical surgical skills. However, metrics such as completion time or subjective performance checklists often show poor correlation to transfer of skills into clinical settings. We hypothesize that non-invas...
Gespeichert in:
Veröffentlicht in: | Surgical endoscopy 2019-08, Vol.33 (8), p.2485-2494 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2494 |
---|---|
container_issue | 8 |
container_start_page | 2485 |
container_title | Surgical endoscopy |
container_volume | 33 |
creator | Nemani, Arun Kruger, Uwe Cooper, Clairice A. Schwaitzberg, Steven D. Intes, Xavier De, Suvranu |
description | Background
Physical and virtual surgical simulators are increasingly being used in training technical surgical skills. However, metrics such as completion time or subjective performance checklists often show poor correlation to transfer of skills into clinical settings. We hypothesize that non-invasive brain imaging can objectively differentiate and classify surgical skill transfer, with higher accuracy than established metrics, for subjects based on motor skill levels.
Study design
18 medical students at University at Buffalo were randomly assigned into control, physical surgical trainer, or virtual trainer groups. Training groups practiced a surgical technical task on respective simulators for 12 consecutive days. To measure skill transfer post-training, all subjects performed the technical task in an ex-vivo environment. Cortical activation was measured using functional near-infrared spectroscopy (fNIRS) in the prefrontal cortex, primary motor cortex, and supplementary motor area, due to their direct impact on motor skill learning.
Results
Classification between simulator trained and untrained subjects based on traditional metrics is poor, where misclassification errors range from 20 to 41%. Conversely, fNIRS metrics can successfully classify physical or virtual trained subjects from untrained subjects with misclassification errors of 2.2% and 8.9%, respectively. More importantly, untrained subjects are successfully classified from physical or virtual simulator trained subjects with misclassification errors of 2.7% and 9.1%, respectively.
Conclusion
fNIRS metrics are significantly more accurate than current established metrics in classifying different levels of surgical motor skill transfer. Our approach brings robustness, objectivity, and accuracy in validating the effectiveness of future surgical trainers in translating surgical skills to clinically relevant environments. |
doi_str_mv | 10.1007/s00464-018-6535-z |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2122587837</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2122587837</sourcerecordid><originalsourceid>FETCH-LOGICAL-c372t-740335efa25d7f4bc85da991d3e42b9fff69dce8b25716c9b1e28d452b14bb4d3</originalsourceid><addsrcrecordid>eNp1kE1LAzEURYMotlZ_gBsZcOMmms-ZyVLELyjUha5DMpOUqdNMzZsp2F9vSquC4CqLd-7Newehc0quKSHFDRAicoEJLXEuucSbAzSmgjPMGC0P0ZgoTjArlBihE4AFSbii8hiNOOFc0Dwfo5eZXbiqb9YuMwAOYOlCn3U-gyHOm8q0Gbw3bZv10QTwLmYDNGGehS7gJqwNbIM2miZkzdLM0-gUHXnTgjvbvxP09nD_eveEp7PH57vbKa54wXpciLSCdN4wWRde2KqUtVGK1twJZpX3Pld15UrLZEHzSlnqWFkLySwV1oqaT9DVrncVu4_BQa-XDVSubU1w3QCaUcZkWZS8SOjlH3TRDTGk7bYUlVIxQRNFd1QVO4DovF7FdFP81JTorW69062Tbr3VrTcpc7FvHuzS1T-Jb78JYDsA0ijMXfz9-v_WL5b-i48</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2121559241</pqid></control><display><type>article</type><title>Objective assessment of surgical skill transfer using non-invasive brain imaging</title><source>MEDLINE</source><source>SpringerLink Journals - AutoHoldings</source><creator>Nemani, Arun ; Kruger, Uwe ; Cooper, Clairice A. ; Schwaitzberg, Steven D. ; Intes, Xavier ; De, Suvranu</creator><creatorcontrib>Nemani, Arun ; Kruger, Uwe ; Cooper, Clairice A. ; Schwaitzberg, Steven D. ; Intes, Xavier ; De, Suvranu</creatorcontrib><description>Background
Physical and virtual surgical simulators are increasingly being used in training technical surgical skills. However, metrics such as completion time or subjective performance checklists often show poor correlation to transfer of skills into clinical settings. We hypothesize that non-invasive brain imaging can objectively differentiate and classify surgical skill transfer, with higher accuracy than established metrics, for subjects based on motor skill levels.
Study design
18 medical students at University at Buffalo were randomly assigned into control, physical surgical trainer, or virtual trainer groups. Training groups practiced a surgical technical task on respective simulators for 12 consecutive days. To measure skill transfer post-training, all subjects performed the technical task in an ex-vivo environment. Cortical activation was measured using functional near-infrared spectroscopy (fNIRS) in the prefrontal cortex, primary motor cortex, and supplementary motor area, due to their direct impact on motor skill learning.
Results
Classification between simulator trained and untrained subjects based on traditional metrics is poor, where misclassification errors range from 20 to 41%. Conversely, fNIRS metrics can successfully classify physical or virtual trained subjects from untrained subjects with misclassification errors of 2.2% and 8.9%, respectively. More importantly, untrained subjects are successfully classified from physical or virtual simulator trained subjects with misclassification errors of 2.7% and 9.1%, respectively.
Conclusion
fNIRS metrics are significantly more accurate than current established metrics in classifying different levels of surgical motor skill transfer. Our approach brings robustness, objectivity, and accuracy in validating the effectiveness of future surgical trainers in translating surgical skills to clinically relevant environments.</description><identifier>ISSN: 0930-2794</identifier><identifier>EISSN: 1432-2218</identifier><identifier>DOI: 10.1007/s00464-018-6535-z</identifier><identifier>PMID: 30334166</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Abdominal Surgery ; Adult ; Brain - diagnostic imaging ; Clinical Competence ; Computer Simulation ; Education, Medical - methods ; Female ; Gastroenterology ; Gynecology ; Hepatology ; Humans ; Learning ; Male ; Medical imaging ; Medical students ; Medicine ; Medicine & Public Health ; Motor ability ; Neuroimaging - methods ; Neurosurgery - education ; Proctology ; Skills ; Students, Medical ; Surgeons ; Surgery ; Training ; User-Computer Interface</subject><ispartof>Surgical endoscopy, 2019-08, Vol.33 (8), p.2485-2494</ispartof><rights>Springer Science+Business Media, LLC, part of Springer Nature 2018</rights><rights>Surgical Endoscopy is a copyright of Springer, (2018). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c372t-740335efa25d7f4bc85da991d3e42b9fff69dce8b25716c9b1e28d452b14bb4d3</citedby><cites>FETCH-LOGICAL-c372t-740335efa25d7f4bc85da991d3e42b9fff69dce8b25716c9b1e28d452b14bb4d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00464-018-6535-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00464-018-6535-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30334166$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Nemani, Arun</creatorcontrib><creatorcontrib>Kruger, Uwe</creatorcontrib><creatorcontrib>Cooper, Clairice A.</creatorcontrib><creatorcontrib>Schwaitzberg, Steven D.</creatorcontrib><creatorcontrib>Intes, Xavier</creatorcontrib><creatorcontrib>De, Suvranu</creatorcontrib><title>Objective assessment of surgical skill transfer using non-invasive brain imaging</title><title>Surgical endoscopy</title><addtitle>Surg Endosc</addtitle><addtitle>Surg Endosc</addtitle><description>Background
Physical and virtual surgical simulators are increasingly being used in training technical surgical skills. However, metrics such as completion time or subjective performance checklists often show poor correlation to transfer of skills into clinical settings. We hypothesize that non-invasive brain imaging can objectively differentiate and classify surgical skill transfer, with higher accuracy than established metrics, for subjects based on motor skill levels.
Study design
18 medical students at University at Buffalo were randomly assigned into control, physical surgical trainer, or virtual trainer groups. Training groups practiced a surgical technical task on respective simulators for 12 consecutive days. To measure skill transfer post-training, all subjects performed the technical task in an ex-vivo environment. Cortical activation was measured using functional near-infrared spectroscopy (fNIRS) in the prefrontal cortex, primary motor cortex, and supplementary motor area, due to their direct impact on motor skill learning.
Results
Classification between simulator trained and untrained subjects based on traditional metrics is poor, where misclassification errors range from 20 to 41%. Conversely, fNIRS metrics can successfully classify physical or virtual trained subjects from untrained subjects with misclassification errors of 2.2% and 8.9%, respectively. More importantly, untrained subjects are successfully classified from physical or virtual simulator trained subjects with misclassification errors of 2.7% and 9.1%, respectively.
Conclusion
fNIRS metrics are significantly more accurate than current established metrics in classifying different levels of surgical motor skill transfer. Our approach brings robustness, objectivity, and accuracy in validating the effectiveness of future surgical trainers in translating surgical skills to clinically relevant environments.</description><subject>Abdominal Surgery</subject><subject>Adult</subject><subject>Brain - diagnostic imaging</subject><subject>Clinical Competence</subject><subject>Computer Simulation</subject><subject>Education, Medical - methods</subject><subject>Female</subject><subject>Gastroenterology</subject><subject>Gynecology</subject><subject>Hepatology</subject><subject>Humans</subject><subject>Learning</subject><subject>Male</subject><subject>Medical imaging</subject><subject>Medical students</subject><subject>Medicine</subject><subject>Medicine & Public Health</subject><subject>Motor ability</subject><subject>Neuroimaging - methods</subject><subject>Neurosurgery - education</subject><subject>Proctology</subject><subject>Skills</subject><subject>Students, Medical</subject><subject>Surgeons</subject><subject>Surgery</subject><subject>Training</subject><subject>User-Computer Interface</subject><issn>0930-2794</issn><issn>1432-2218</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><recordid>eNp1kE1LAzEURYMotlZ_gBsZcOMmms-ZyVLELyjUha5DMpOUqdNMzZsp2F9vSquC4CqLd-7Newehc0quKSHFDRAicoEJLXEuucSbAzSmgjPMGC0P0ZgoTjArlBihE4AFSbii8hiNOOFc0Dwfo5eZXbiqb9YuMwAOYOlCn3U-gyHOm8q0Gbw3bZv10QTwLmYDNGGehS7gJqwNbIM2miZkzdLM0-gUHXnTgjvbvxP09nD_eveEp7PH57vbKa54wXpciLSCdN4wWRde2KqUtVGK1twJZpX3Pld15UrLZEHzSlnqWFkLySwV1oqaT9DVrncVu4_BQa-XDVSubU1w3QCaUcZkWZS8SOjlH3TRDTGk7bYUlVIxQRNFd1QVO4DovF7FdFP81JTorW69062Tbr3VrTcpc7FvHuzS1T-Jb78JYDsA0ijMXfz9-v_WL5b-i48</recordid><startdate>20190801</startdate><enddate>20190801</enddate><creator>Nemani, Arun</creator><creator>Kruger, Uwe</creator><creator>Cooper, Clairice A.</creator><creator>Schwaitzberg, Steven D.</creator><creator>Intes, Xavier</creator><creator>De, Suvranu</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>M1P</scope><scope>NAPCQ</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope></search><sort><creationdate>20190801</creationdate><title>Objective assessment of surgical skill transfer using non-invasive brain imaging</title><author>Nemani, Arun ; Kruger, Uwe ; Cooper, Clairice A. ; Schwaitzberg, Steven D. ; Intes, Xavier ; De, Suvranu</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c372t-740335efa25d7f4bc85da991d3e42b9fff69dce8b25716c9b1e28d452b14bb4d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Abdominal Surgery</topic><topic>Adult</topic><topic>Brain - diagnostic imaging</topic><topic>Clinical Competence</topic><topic>Computer Simulation</topic><topic>Education, Medical - methods</topic><topic>Female</topic><topic>Gastroenterology</topic><topic>Gynecology</topic><topic>Hepatology</topic><topic>Humans</topic><topic>Learning</topic><topic>Male</topic><topic>Medical imaging</topic><topic>Medical students</topic><topic>Medicine</topic><topic>Medicine & Public Health</topic><topic>Motor ability</topic><topic>Neuroimaging - methods</topic><topic>Neurosurgery - education</topic><topic>Proctology</topic><topic>Skills</topic><topic>Students, Medical</topic><topic>Surgeons</topic><topic>Surgery</topic><topic>Training</topic><topic>User-Computer Interface</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Nemani, Arun</creatorcontrib><creatorcontrib>Kruger, Uwe</creatorcontrib><creatorcontrib>Cooper, Clairice A.</creatorcontrib><creatorcontrib>Schwaitzberg, Steven D.</creatorcontrib><creatorcontrib>Intes, Xavier</creatorcontrib><creatorcontrib>De, Suvranu</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing & Allied Health Database</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Nursing & Allied Health Premium</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><jtitle>Surgical endoscopy</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Nemani, Arun</au><au>Kruger, Uwe</au><au>Cooper, Clairice A.</au><au>Schwaitzberg, Steven D.</au><au>Intes, Xavier</au><au>De, Suvranu</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Objective assessment of surgical skill transfer using non-invasive brain imaging</atitle><jtitle>Surgical endoscopy</jtitle><stitle>Surg Endosc</stitle><addtitle>Surg Endosc</addtitle><date>2019-08-01</date><risdate>2019</risdate><volume>33</volume><issue>8</issue><spage>2485</spage><epage>2494</epage><pages>2485-2494</pages><issn>0930-2794</issn><eissn>1432-2218</eissn><abstract>Background
Physical and virtual surgical simulators are increasingly being used in training technical surgical skills. However, metrics such as completion time or subjective performance checklists often show poor correlation to transfer of skills into clinical settings. We hypothesize that non-invasive brain imaging can objectively differentiate and classify surgical skill transfer, with higher accuracy than established metrics, for subjects based on motor skill levels.
Study design
18 medical students at University at Buffalo were randomly assigned into control, physical surgical trainer, or virtual trainer groups. Training groups practiced a surgical technical task on respective simulators for 12 consecutive days. To measure skill transfer post-training, all subjects performed the technical task in an ex-vivo environment. Cortical activation was measured using functional near-infrared spectroscopy (fNIRS) in the prefrontal cortex, primary motor cortex, and supplementary motor area, due to their direct impact on motor skill learning.
Results
Classification between simulator trained and untrained subjects based on traditional metrics is poor, where misclassification errors range from 20 to 41%. Conversely, fNIRS metrics can successfully classify physical or virtual trained subjects from untrained subjects with misclassification errors of 2.2% and 8.9%, respectively. More importantly, untrained subjects are successfully classified from physical or virtual simulator trained subjects with misclassification errors of 2.7% and 9.1%, respectively.
Conclusion
fNIRS metrics are significantly more accurate than current established metrics in classifying different levels of surgical motor skill transfer. Our approach brings robustness, objectivity, and accuracy in validating the effectiveness of future surgical trainers in translating surgical skills to clinically relevant environments.</abstract><cop>New York</cop><pub>Springer US</pub><pmid>30334166</pmid><doi>10.1007/s00464-018-6535-z</doi><tpages>10</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0930-2794 |
ispartof | Surgical endoscopy, 2019-08, Vol.33 (8), p.2485-2494 |
issn | 0930-2794 1432-2218 |
language | eng |
recordid | cdi_proquest_miscellaneous_2122587837 |
source | MEDLINE; SpringerLink Journals - AutoHoldings |
subjects | Abdominal Surgery Adult Brain - diagnostic imaging Clinical Competence Computer Simulation Education, Medical - methods Female Gastroenterology Gynecology Hepatology Humans Learning Male Medical imaging Medical students Medicine Medicine & Public Health Motor ability Neuroimaging - methods Neurosurgery - education Proctology Skills Students, Medical Surgeons Surgery Training User-Computer Interface |
title | Objective assessment of surgical skill transfer using non-invasive brain imaging |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T16%3A22%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Objective%20assessment%20of%20surgical%20skill%20transfer%20using%20non-invasive%20brain%20imaging&rft.jtitle=Surgical%20endoscopy&rft.au=Nemani,%20Arun&rft.date=2019-08-01&rft.volume=33&rft.issue=8&rft.spage=2485&rft.epage=2494&rft.pages=2485-2494&rft.issn=0930-2794&rft.eissn=1432-2218&rft_id=info:doi/10.1007/s00464-018-6535-z&rft_dat=%3Cproquest_cross%3E2122587837%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2121559241&rft_id=info:pmid/30334166&rfr_iscdi=true |