Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology

We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality (AR) and compare the needle placement performance of this AR system with ultrasound-guided freehand navigation in phantoms. A head-mounted display-based AR navigation system was developed...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Shanghai jiao tong da xue xue bao 2023-08, Vol.28 (4), p.517-525
Hauptverfasser: Yu, Jiaqi, Wang, Shuyi, Wang, Yuqi, Xie, Hua, Wu, Zhanglei, Fu, Xiaoni, Ma, Bangfeng
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 525
container_issue 4
container_start_page 517
container_title Shanghai jiao tong da xue xue bao
container_volume 28
creator Yu, Jiaqi
Wang, Shuyi
Wang, Yuqi
Xie, Hua
Wu, Zhanglei
Fu, Xiaoni
Ma, Bangfeng
description We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality (AR) and compare the needle placement performance of this AR system with ultrasound-guided freehand navigation in phantoms. A head-mounted display-based AR navigation system was developed using the Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complex anatomical structures onto a phantom in real time. The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system. To evaluate the tracking accuracy, 15 participants (7 males and 8 females) performed a single needle insertion using AR navigation (the number of punctures n = 75) and ultrasound-guided freehand navigation ( n = 75). The needle placement error was measured as the Euclidean distance between the actual needle tip and the virtual target by MicronTracker. All participants demonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared with the ultrasound-guided freehand method. The needle insertion error of the ultrasound-guided method showed an increased error compared with the AR method (5.54mm ± 2.59mm, 4.34mm ± 2.10mm, respectively, p < 0.05). The ultrasound-guided needle placements showed an increased time compared with the AR method (19.08 s ± 3.59 s, 15.14 s ± 2.72 s, respectively, p < 0.0001). Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems. The system has the potential to increase efficiency and effectiveness of percutaneous renal puncture training.
doi_str_mv 10.1007/s12204-022-2554-y
format Article
fullrecord <record><control><sourceid>wanfang_jour_proqu</sourceid><recordid>TN_cdi_wanfang_journals_shjtdxxb_e202304013</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><wanfj_id>shjtdxxb_e202304013</wanfj_id><sourcerecordid>shjtdxxb_e202304013</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2473-297011d5f08d85cc177c52a5b5450445bc4d4944d0b9339570054a5f068527373</originalsourceid><addsrcrecordid>eNqFkU1LxDAQhosouH78AG8Bj1KdpMkmPcriF4iKrF5DNk27XbrJmjRq_fVmqeBJvMzM4XlfZubNshMM5xiAXwRMCNAcCMkJYzQfdrIJLkuWCyzEbpoTlGPMyX52EMIKgEJRlJOsenDvpkOvbYiqa79U3zqL5s51qHYePRmvY6-scTGgZ2NVh56i1X30Bs29am1rG_QStvUyNmtje1MlLjn1A5obvbSuc81wlO3Vqgvm-KcfZi_XV_PZbX7_eHM3u7zPNaG8yEnJAeOK1SAqwbTGnGtGFFswyoBSttC0oiWlFSzKtDzjAIyqhE8FI7zgxWF2Nvp-KFsr28iViz4tHWRYrvrq83MhDQFSpONxkejTkd549xZN6H9xIigVDISg_1F4WnIqEoVHSnsXgje13Ph2rfwgMcjt7-UYkEwByW1AckgaMmpCYm1j_K_z36JvseORxw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2844169748</pqid></control><display><type>article</type><title>Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology</title><source>Springer Nature - Complete Springer Journals</source><source>DOAJ Directory of Open Access Journals</source><creator>Yu, Jiaqi ; Wang, Shuyi ; Wang, Yuqi ; Xie, Hua ; Wu, Zhanglei ; Fu, Xiaoni ; Ma, Bangfeng</creator><creatorcontrib>Yu, Jiaqi ; Wang, Shuyi ; Wang, Yuqi ; Xie, Hua ; Wu, Zhanglei ; Fu, Xiaoni ; Ma, Bangfeng</creatorcontrib><description>We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality (AR) and compare the needle placement performance of this AR system with ultrasound-guided freehand navigation in phantoms. A head-mounted display-based AR navigation system was developed using the Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complex anatomical structures onto a phantom in real time. The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system. To evaluate the tracking accuracy, 15 participants (7 males and 8 females) performed a single needle insertion using AR navigation (the number of punctures n = 75) and ultrasound-guided freehand navigation ( n = 75). The needle placement error was measured as the Euclidean distance between the actual needle tip and the virtual target by MicronTracker. All participants demonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared with the ultrasound-guided freehand method. The needle insertion error of the ultrasound-guided method showed an increased error compared with the AR method (5.54mm ± 2.59mm, 4.34mm ± 2.10mm, respectively, p &lt; 0.05). The ultrasound-guided needle placements showed an increased time compared with the AR method (19.08 s ± 3.59 s, 15.14 s ± 2.72 s, respectively, p &lt; 0.0001). Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems. The system has the potential to increase efficiency and effectiveness of percutaneous renal puncture training.</description><identifier>ISSN: 1007-1172</identifier><identifier>ISSN: 1674-8115</identifier><identifier>EISSN: 1995-8188</identifier><identifier>DOI: 10.1007/s12204-022-2554-y</identifier><language>eng</language><publisher>Shanghai: Shanghai Jiaotong University Press</publisher><subject>Architecture ; Augmented reality ; Computer Science ; Electrical Engineering ; Engineering ; Error analysis ; Euclidean geometry ; Hand eye coordination ; Helmet mounted displays ; Insertion ; Kidneys ; Life Sciences ; Materials Science ; Motion capture ; Navigation systems ; Original Paper ; Placement ; Training ; Ultrasonic imaging ; Ultrasonic testing ; Ultrasound ; Visual programming languages ; Visualization</subject><ispartof>Shanghai jiao tong da xue xue bao, 2023-08, Vol.28 (4), p.517-525</ispartof><rights>Shanghai Jiao Tong University 2022</rights><rights>Shanghai Jiao Tong University 2022.</rights><rights>Copyright Shanghai Jiaotong University Press Aug 2023</rights><rights>Copyright © Wanfang Data Co. Ltd. All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c2473-297011d5f08d85cc177c52a5b5450445bc4d4944d0b9339570054a5f068527373</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Uhttp://www.wanfangdata.com.cn/images/PeriodicalImages/shjtdxxb-e/shjtdxxb-e.jpg</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s12204-022-2554-y$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s12204-022-2554-y$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,860,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Yu, Jiaqi</creatorcontrib><creatorcontrib>Wang, Shuyi</creatorcontrib><creatorcontrib>Wang, Yuqi</creatorcontrib><creatorcontrib>Xie, Hua</creatorcontrib><creatorcontrib>Wu, Zhanglei</creatorcontrib><creatorcontrib>Fu, Xiaoni</creatorcontrib><creatorcontrib>Ma, Bangfeng</creatorcontrib><title>Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology</title><title>Shanghai jiao tong da xue xue bao</title><addtitle>J. Shanghai Jiaotong Univ. (Sci.)</addtitle><description>We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality (AR) and compare the needle placement performance of this AR system with ultrasound-guided freehand navigation in phantoms. A head-mounted display-based AR navigation system was developed using the Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complex anatomical structures onto a phantom in real time. The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system. To evaluate the tracking accuracy, 15 participants (7 males and 8 females) performed a single needle insertion using AR navigation (the number of punctures n = 75) and ultrasound-guided freehand navigation ( n = 75). The needle placement error was measured as the Euclidean distance between the actual needle tip and the virtual target by MicronTracker. All participants demonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared with the ultrasound-guided freehand method. The needle insertion error of the ultrasound-guided method showed an increased error compared with the AR method (5.54mm ± 2.59mm, 4.34mm ± 2.10mm, respectively, p &lt; 0.05). The ultrasound-guided needle placements showed an increased time compared with the AR method (19.08 s ± 3.59 s, 15.14 s ± 2.72 s, respectively, p &lt; 0.0001). Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems. The system has the potential to increase efficiency and effectiveness of percutaneous renal puncture training.</description><subject>Architecture</subject><subject>Augmented reality</subject><subject>Computer Science</subject><subject>Electrical Engineering</subject><subject>Engineering</subject><subject>Error analysis</subject><subject>Euclidean geometry</subject><subject>Hand eye coordination</subject><subject>Helmet mounted displays</subject><subject>Insertion</subject><subject>Kidneys</subject><subject>Life Sciences</subject><subject>Materials Science</subject><subject>Motion capture</subject><subject>Navigation systems</subject><subject>Original Paper</subject><subject>Placement</subject><subject>Training</subject><subject>Ultrasonic imaging</subject><subject>Ultrasonic testing</subject><subject>Ultrasound</subject><subject>Visual programming languages</subject><subject>Visualization</subject><issn>1007-1172</issn><issn>1674-8115</issn><issn>1995-8188</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNqFkU1LxDAQhosouH78AG8Bj1KdpMkmPcriF4iKrF5DNk27XbrJmjRq_fVmqeBJvMzM4XlfZubNshMM5xiAXwRMCNAcCMkJYzQfdrIJLkuWCyzEbpoTlGPMyX52EMIKgEJRlJOsenDvpkOvbYiqa79U3zqL5s51qHYePRmvY6-scTGgZ2NVh56i1X30Bs29am1rG_QStvUyNmtje1MlLjn1A5obvbSuc81wlO3Vqgvm-KcfZi_XV_PZbX7_eHM3u7zPNaG8yEnJAeOK1SAqwbTGnGtGFFswyoBSttC0oiWlFSzKtDzjAIyqhE8FI7zgxWF2Nvp-KFsr28iViz4tHWRYrvrq83MhDQFSpONxkejTkd549xZN6H9xIigVDISg_1F4WnIqEoVHSnsXgje13Ph2rfwgMcjt7-UYkEwByW1AckgaMmpCYm1j_K_z36JvseORxw</recordid><startdate>20230801</startdate><enddate>20230801</enddate><creator>Yu, Jiaqi</creator><creator>Wang, Shuyi</creator><creator>Wang, Yuqi</creator><creator>Xie, Hua</creator><creator>Wu, Zhanglei</creator><creator>Fu, Xiaoni</creator><creator>Ma, Bangfeng</creator><general>Shanghai Jiaotong University Press</general><general>Springer Nature B.V</general><general>School of Medical Instrument and Food Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China%Department of Urology,Shanghai Children's Hospital,Shanghai Jiao Tong University School of Medicine,Shanghai 200062,China</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>FR3</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7QL</scope><scope>7QO</scope><scope>7QP</scope><scope>7T5</scope><scope>7TK</scope><scope>7TM</scope><scope>7TO</scope><scope>7U9</scope><scope>C1K</scope><scope>H94</scope><scope>M7N</scope><scope>P64</scope><scope>RC3</scope><scope>2B.</scope><scope>4A8</scope><scope>92I</scope><scope>93N</scope><scope>PSX</scope><scope>TCJ</scope></search><sort><creationdate>20230801</creationdate><title>Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology</title><author>Yu, Jiaqi ; Wang, Shuyi ; Wang, Yuqi ; Xie, Hua ; Wu, Zhanglei ; Fu, Xiaoni ; Ma, Bangfeng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2473-297011d5f08d85cc177c52a5b5450445bc4d4944d0b9339570054a5f068527373</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Architecture</topic><topic>Augmented reality</topic><topic>Computer Science</topic><topic>Electrical Engineering</topic><topic>Engineering</topic><topic>Error analysis</topic><topic>Euclidean geometry</topic><topic>Hand eye coordination</topic><topic>Helmet mounted displays</topic><topic>Insertion</topic><topic>Kidneys</topic><topic>Life Sciences</topic><topic>Materials Science</topic><topic>Motion capture</topic><topic>Navigation systems</topic><topic>Original Paper</topic><topic>Placement</topic><topic>Training</topic><topic>Ultrasonic imaging</topic><topic>Ultrasonic testing</topic><topic>Ultrasound</topic><topic>Visual programming languages</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yu, Jiaqi</creatorcontrib><creatorcontrib>Wang, Shuyi</creatorcontrib><creatorcontrib>Wang, Yuqi</creatorcontrib><creatorcontrib>Xie, Hua</creatorcontrib><creatorcontrib>Wu, Zhanglei</creatorcontrib><creatorcontrib>Fu, Xiaoni</creatorcontrib><creatorcontrib>Ma, Bangfeng</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Calcium &amp; Calcified Tissue Abstracts</collection><collection>Immunology Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Oncogenes and Growth Factors Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Environmental Sciences and Pollution Management</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Genetics Abstracts</collection><collection>Wanfang Data Journals - Hong Kong</collection><collection>WANFANG Data Centre</collection><collection>Wanfang Data Journals</collection><collection>万方数据期刊 - 香港版</collection><collection>China Online Journals (COJ)</collection><collection>China Online Journals (COJ)</collection><jtitle>Shanghai jiao tong da xue xue bao</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yu, Jiaqi</au><au>Wang, Shuyi</au><au>Wang, Yuqi</au><au>Xie, Hua</au><au>Wu, Zhanglei</au><au>Fu, Xiaoni</au><au>Ma, Bangfeng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology</atitle><jtitle>Shanghai jiao tong da xue xue bao</jtitle><stitle>J. Shanghai Jiaotong Univ. (Sci.)</stitle><date>2023-08-01</date><risdate>2023</risdate><volume>28</volume><issue>4</issue><spage>517</spage><epage>525</epage><pages>517-525</pages><issn>1007-1172</issn><issn>1674-8115</issn><eissn>1995-8188</eissn><abstract>We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality (AR) and compare the needle placement performance of this AR system with ultrasound-guided freehand navigation in phantoms. A head-mounted display-based AR navigation system was developed using the Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complex anatomical structures onto a phantom in real time. The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system. To evaluate the tracking accuracy, 15 participants (7 males and 8 females) performed a single needle insertion using AR navigation (the number of punctures n = 75) and ultrasound-guided freehand navigation ( n = 75). The needle placement error was measured as the Euclidean distance between the actual needle tip and the virtual target by MicronTracker. All participants demonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared with the ultrasound-guided freehand method. The needle insertion error of the ultrasound-guided method showed an increased error compared with the AR method (5.54mm ± 2.59mm, 4.34mm ± 2.10mm, respectively, p &lt; 0.05). The ultrasound-guided needle placements showed an increased time compared with the AR method (19.08 s ± 3.59 s, 15.14 s ± 2.72 s, respectively, p &lt; 0.0001). Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems. The system has the potential to increase efficiency and effectiveness of percutaneous renal puncture training.</abstract><cop>Shanghai</cop><pub>Shanghai Jiaotong University Press</pub><doi>10.1007/s12204-022-2554-y</doi><tpages>9</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1007-1172
ispartof Shanghai jiao tong da xue xue bao, 2023-08, Vol.28 (4), p.517-525
issn 1007-1172
1674-8115
1995-8188
language eng
recordid cdi_wanfang_journals_shjtdxxb_e202304013
source Springer Nature - Complete Springer Journals; DOAJ Directory of Open Access Journals
subjects Architecture
Augmented reality
Computer Science
Electrical Engineering
Engineering
Error analysis
Euclidean geometry
Hand eye coordination
Helmet mounted displays
Insertion
Kidneys
Life Sciences
Materials Science
Motion capture
Navigation systems
Original Paper
Placement
Training
Ultrasonic imaging
Ultrasonic testing
Ultrasound
Visual programming languages
Visualization
title Novel Visualization Tool for Percutaneous Renal Puncture Training Using Augmented Reality Technology
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-12T22%3A04%3A59IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-wanfang_jour_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Novel%20Visualization%20Tool%20for%20Percutaneous%20Renal%20Puncture%20Training%20Using%20Augmented%20Reality%20Technology&rft.jtitle=Shanghai%20jiao%20tong%20da%20xue%20xue%20bao&rft.au=Yu,%20Jiaqi&rft.date=2023-08-01&rft.volume=28&rft.issue=4&rft.spage=517&rft.epage=525&rft.pages=517-525&rft.issn=1007-1172&rft.eissn=1995-8188&rft_id=info:doi/10.1007/s12204-022-2554-y&rft_dat=%3Cwanfang_jour_proqu%3Eshjtdxxb_e202304013%3C/wanfang_jour_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2844169748&rft_id=info:pmid/&rft_wanfj_id=shjtdxxb_e202304013&rfr_iscdi=true