Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy
Background Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot‐assisted minimally invasive surgery has mainly focussed on superimposing preoperative three‐dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for...
Gespeichert in:
| Veröffentlicht in: | The international journal of medical robotics + computer assisted surgery 2022-04, Vol.18 (2), p.e2351-n/a |
|---|---|
| Hauptverfasser: | , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | n/a |
|---|---|
| container_issue | 2 |
| container_start_page | e2351 |
| container_title | The international journal of medical robotics + computer assisted surgery |
| container_volume | 18 |
| creator | Forte, Maria‐Paola Gourishetti, Ravali Javot, Bernard Engler, Tobias Gomez, Ernest D. Kuchenbecker, Katherine J. |
| description | Background
Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot‐assisted minimally invasive surgery has mainly focussed on superimposing preoperative three‐dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery.
Methods
We designed, built and evaluated four voice‐controlled functions: viewing a live video of the operating room, viewing two‐dimensional preoperative images, measuring 3D distances and warning about out‐of‐view instruments. This low‐cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer.
Results
Eight experienced surgeons performed dry‐lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands.
Conclusions
The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration. |
| doi_str_mv | 10.1002/rcs.2351 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2598079248</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2598079248</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3831-14d1ad51d6b0252674164483f9eb048b55acf89e752fd7ee8209d8aa591662783</originalsourceid><addsrcrecordid>eNp1kdtKxDAQhoMouh7AJ5CAN95UkzRJ00tZj7AgeADvQtpM10rbrEm70jsfwWf0Sey6uoLg1cwwHx_D_AjtU3JMCWEnPg_HLBZ0DY0oT1QkUvm4vuoF3ULbITwTwgWXfBNtxcOCcspH6OUMQjltsCtw2bTgTd6Wc8Cmm9YwzBZ7MFXZ9rjommHlmoAL57F3mWvLHIfOT8H32DQWw9xUnVkwgwpb33-8vVcmw1Vfz56MhQby1tX9LtooTBVg77vuoIeL8_vxVTS5ubwen06iPFYxjSi31FhBrcwIE0wmnErOVVykkBGuMiFMXqgUEsEKmwAoRlKrjBEplZIlKt5BR0vvzLuXDkKr6zLkUFWmAdcFzUSqSJIyvkAP_6DPrvPNcJ1mMuZSpITKX2HuXQgeCj3zZW18rynRixj0EINexDCgB9_CLqvBrsCfvw9AtAReywr6f0X6dnz3JfwEbhSS1A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2634659016</pqid></control><display><type>article</type><title>Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy</title><source>MEDLINE</source><source>Wiley Online Library Journals Frontfile Complete</source><creator>Forte, Maria‐Paola ; Gourishetti, Ravali ; Javot, Bernard ; Engler, Tobias ; Gomez, Ernest D. ; Kuchenbecker, Katherine J.</creator><creatorcontrib>Forte, Maria‐Paola ; Gourishetti, Ravali ; Javot, Bernard ; Engler, Tobias ; Gomez, Ernest D. ; Kuchenbecker, Katherine J.</creatorcontrib><description>Background
Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot‐assisted minimally invasive surgery has mainly focussed on superimposing preoperative three‐dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery.
Methods
We designed, built and evaluated four voice‐controlled functions: viewing a live video of the operating room, viewing two‐dimensional preoperative images, measuring 3D distances and warning about out‐of‐view instruments. This low‐cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer.
Results
Eight experienced surgeons performed dry‐lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands.
Conclusions
The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration.</description><identifier>ISSN: 1478-5951</identifier><identifier>EISSN: 1478-596X</identifier><identifier>DOI: 10.1002/rcs.2351</identifier><identifier>PMID: 34781414</identifier><language>eng</language><publisher>England: Wiley Subscription Services, Inc</publisher><subject>Augmented Reality ; Evaluation ; Humans ; Imaging, Three-Dimensional ; laparoscopic surgery ; Lymph Node Excision ; Measuring instruments ; Medical imaging ; Minimally invasive surgery ; Minimally Invasive Surgical Procedures ; Robotic surgery ; Robotic Surgical Procedures - methods ; Surgeons ; Surgery, Computer-Assisted - methods ; Viewing ; Voice control</subject><ispartof>The international journal of medical robotics + computer assisted surgery, 2022-04, Vol.18 (2), p.e2351-n/a</ispartof><rights>2021 The Authors. The International Journal of Medical Robotics and Computer Assisted Surgery published by John Wiley & Sons Ltd.</rights><rights>2021. This article is published under http://creativecommons.org/licenses/by-nc/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3831-14d1ad51d6b0252674164483f9eb048b55acf89e752fd7ee8209d8aa591662783</citedby><cites>FETCH-LOGICAL-c3831-14d1ad51d6b0252674164483f9eb048b55acf89e752fd7ee8209d8aa591662783</cites><orcidid>0000-0002-9153-7350 ; 0000-0002-3949-6846 ; 0000-0003-0767-8378 ; 0000-0002-5004-0313 ; 0000-0003-3765-5492</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Frcs.2351$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Frcs.2351$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,1411,27901,27902,45550,45551</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34781414$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Forte, Maria‐Paola</creatorcontrib><creatorcontrib>Gourishetti, Ravali</creatorcontrib><creatorcontrib>Javot, Bernard</creatorcontrib><creatorcontrib>Engler, Tobias</creatorcontrib><creatorcontrib>Gomez, Ernest D.</creatorcontrib><creatorcontrib>Kuchenbecker, Katherine J.</creatorcontrib><title>Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy</title><title>The international journal of medical robotics + computer assisted surgery</title><addtitle>Int J Med Robot</addtitle><description>Background
Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot‐assisted minimally invasive surgery has mainly focussed on superimposing preoperative three‐dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery.
Methods
We designed, built and evaluated four voice‐controlled functions: viewing a live video of the operating room, viewing two‐dimensional preoperative images, measuring 3D distances and warning about out‐of‐view instruments. This low‐cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer.
Results
Eight experienced surgeons performed dry‐lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands.
Conclusions
The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration.</description><subject>Augmented Reality</subject><subject>Evaluation</subject><subject>Humans</subject><subject>Imaging, Three-Dimensional</subject><subject>laparoscopic surgery</subject><subject>Lymph Node Excision</subject><subject>Measuring instruments</subject><subject>Medical imaging</subject><subject>Minimally invasive surgery</subject><subject>Minimally Invasive Surgical Procedures</subject><subject>Robotic surgery</subject><subject>Robotic Surgical Procedures - methods</subject><subject>Surgeons</subject><subject>Surgery, Computer-Assisted - methods</subject><subject>Viewing</subject><subject>Voice control</subject><issn>1478-5951</issn><issn>1478-596X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><sourceid>EIF</sourceid><recordid>eNp1kdtKxDAQhoMouh7AJ5CAN95UkzRJ00tZj7AgeADvQtpM10rbrEm70jsfwWf0Sey6uoLg1cwwHx_D_AjtU3JMCWEnPg_HLBZ0DY0oT1QkUvm4vuoF3ULbITwTwgWXfBNtxcOCcspH6OUMQjltsCtw2bTgTd6Wc8Cmm9YwzBZ7MFXZ9rjommHlmoAL57F3mWvLHIfOT8H32DQWw9xUnVkwgwpb33-8vVcmw1Vfz56MhQby1tX9LtooTBVg77vuoIeL8_vxVTS5ubwen06iPFYxjSi31FhBrcwIE0wmnErOVVykkBGuMiFMXqgUEsEKmwAoRlKrjBEplZIlKt5BR0vvzLuXDkKr6zLkUFWmAdcFzUSqSJIyvkAP_6DPrvPNcJ1mMuZSpITKX2HuXQgeCj3zZW18rynRixj0EINexDCgB9_CLqvBrsCfvw9AtAReywr6f0X6dnz3JfwEbhSS1A</recordid><startdate>202204</startdate><enddate>202204</enddate><creator>Forte, Maria‐Paola</creator><creator>Gourishetti, Ravali</creator><creator>Javot, Bernard</creator><creator>Engler, Tobias</creator><creator>Gomez, Ernest D.</creator><creator>Kuchenbecker, Katherine J.</creator><general>Wiley Subscription Services, Inc</general><scope>24P</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>JQ2</scope><scope>K9.</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-9153-7350</orcidid><orcidid>https://orcid.org/0000-0002-3949-6846</orcidid><orcidid>https://orcid.org/0000-0003-0767-8378</orcidid><orcidid>https://orcid.org/0000-0002-5004-0313</orcidid><orcidid>https://orcid.org/0000-0003-3765-5492</orcidid></search><sort><creationdate>202204</creationdate><title>Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy</title><author>Forte, Maria‐Paola ; Gourishetti, Ravali ; Javot, Bernard ; Engler, Tobias ; Gomez, Ernest D. ; Kuchenbecker, Katherine J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3831-14d1ad51d6b0252674164483f9eb048b55acf89e752fd7ee8209d8aa591662783</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Augmented Reality</topic><topic>Evaluation</topic><topic>Humans</topic><topic>Imaging, Three-Dimensional</topic><topic>laparoscopic surgery</topic><topic>Lymph Node Excision</topic><topic>Measuring instruments</topic><topic>Medical imaging</topic><topic>Minimally invasive surgery</topic><topic>Minimally Invasive Surgical Procedures</topic><topic>Robotic surgery</topic><topic>Robotic Surgical Procedures - methods</topic><topic>Surgeons</topic><topic>Surgery, Computer-Assisted - methods</topic><topic>Viewing</topic><topic>Voice control</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Forte, Maria‐Paola</creatorcontrib><creatorcontrib>Gourishetti, Ravali</creatorcontrib><creatorcontrib>Javot, Bernard</creatorcontrib><creatorcontrib>Engler, Tobias</creatorcontrib><creatorcontrib>Gomez, Ernest D.</creatorcontrib><creatorcontrib>Kuchenbecker, Katherine J.</creatorcontrib><collection>Wiley-Blackwell Open Access Titles</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>The international journal of medical robotics + computer assisted surgery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Forte, Maria‐Paola</au><au>Gourishetti, Ravali</au><au>Javot, Bernard</au><au>Engler, Tobias</au><au>Gomez, Ernest D.</au><au>Kuchenbecker, Katherine J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy</atitle><jtitle>The international journal of medical robotics + computer assisted surgery</jtitle><addtitle>Int J Med Robot</addtitle><date>2022-04</date><risdate>2022</risdate><volume>18</volume><issue>2</issue><spage>e2351</spage><epage>n/a</epage><pages>e2351-n/a</pages><issn>1478-5951</issn><eissn>1478-596X</eissn><abstract>Background
Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot‐assisted minimally invasive surgery has mainly focussed on superimposing preoperative three‐dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery.
Methods
We designed, built and evaluated four voice‐controlled functions: viewing a live video of the operating room, viewing two‐dimensional preoperative images, measuring 3D distances and warning about out‐of‐view instruments. This low‐cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer.
Results
Eight experienced surgeons performed dry‐lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands.
Conclusions
The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration.</abstract><cop>England</cop><pub>Wiley Subscription Services, Inc</pub><pmid>34781414</pmid><doi>10.1002/rcs.2351</doi><tpages>17</tpages><orcidid>https://orcid.org/0000-0002-9153-7350</orcidid><orcidid>https://orcid.org/0000-0002-3949-6846</orcidid><orcidid>https://orcid.org/0000-0003-0767-8378</orcidid><orcidid>https://orcid.org/0000-0002-5004-0313</orcidid><orcidid>https://orcid.org/0000-0003-3765-5492</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1478-5951 |
| ispartof | The international journal of medical robotics + computer assisted surgery, 2022-04, Vol.18 (2), p.e2351-n/a |
| issn | 1478-5951 1478-596X |
| language | eng |
| recordid | cdi_proquest_miscellaneous_2598079248 |
| source | MEDLINE; Wiley Online Library Journals Frontfile Complete |
| subjects | Augmented Reality Evaluation Humans Imaging, Three-Dimensional laparoscopic surgery Lymph Node Excision Measuring instruments Medical imaging Minimally invasive surgery Minimally Invasive Surgical Procedures Robotic surgery Robotic Surgical Procedures - methods Surgeons Surgery, Computer-Assisted - methods Viewing Voice control |
| title | Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T21%3A55%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Design%20of%20interactive%20augmented%20reality%20functions%20for%20robotic%20surgery%20and%20evaluation%20in%20dry%E2%80%90lab%20lymphadenectomy&rft.jtitle=The%20international%20journal%20of%20medical%20robotics%20+%20computer%20assisted%20surgery&rft.au=Forte,%20Maria%E2%80%90Paola&rft.date=2022-04&rft.volume=18&rft.issue=2&rft.spage=e2351&rft.epage=n/a&rft.pages=e2351-n/a&rft.issn=1478-5951&rft.eissn=1478-596X&rft_id=info:doi/10.1002/rcs.2351&rft_dat=%3Cproquest_cross%3E2598079248%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2634659016&rft_id=info:pmid/34781414&rfr_iscdi=true |