Haptic and visual augmented reality interface for programming welding robots

It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The prop...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Advances in manufacturing 2017-09, Vol.5 (3), p.191-198
Hauptverfasser: Ni, D., Yew, A. W. W., Ong, S. K., Nee, A. Y. C.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 198
container_issue 3
container_start_page 191
container_title Advances in manufacturing
container_volume 5
creator Ni, D.
Yew, A. W. W.
Ong, S. K.
Nee, A. Y. C.
description It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming with- out prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.
doi_str_mv 10.1007/s40436-017-0184-7
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_1939465682</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><cqvip_id>673779490</cqvip_id><sourcerecordid>1939465682</sourcerecordid><originalsourceid>FETCH-LOGICAL-c386t-899c0404b29757dbf42cc8e1de6bb727547813abeeaf4d55ab28e3bbea2e935d3</originalsourceid><addsrcrecordid>eNp9UEtLxDAQDqLgsu4P8Bb0XM07zVEWdYUFL3oOSTutlT52k1bZf2_KLuLJwzAzzPcYPoSuKbmjhOj7KIjgKiNUp8pFps_QglEjMy6NPk8zmWfK9CVaxdh4wtR8oWqBthu3G5sCu77EX02cXIvdVHfQj1DiAK5txgNu0hYqVwCuhoB3YaiD67qmr_E3tOXcw-CHMV6hi8q1EVanvkTvT49v6022fX1-WT9ss4LnasxyYwqSXvbMaKlLXwlWFDnQEpT3mmkpdE658wCuEqWUzrMcuPfgGBguS75Et0fd9Mp-gjjaz2EKfbK01HAjlFQ5Syh6RBVhiDFAZXeh6Vw4WErsnJs95mZTbnbOzerEYUdOTNi-hvBH-R_SzcnoY-jrfeL9OinNtTbCEP4DU_t8eQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1939465682</pqid></control><display><type>article</type><title>Haptic and visual augmented reality interface for programming welding robots</title><source>2022 ECC(Springer)</source><creator>Ni, D. ; Yew, A. W. W. ; Ong, S. K. ; Nee, A. Y. C.</creator><creatorcontrib>Ni, D. ; Yew, A. W. W. ; Ong, S. K. ; Nee, A. Y. C.</creatorcontrib><description>It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming with- out prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.</description><identifier>ISSN: 2095-3127</identifier><identifier>EISSN: 2195-3597</identifier><identifier>DOI: 10.1007/s40436-017-0184-7</identifier><language>eng</language><publisher>Shanghai: Shanghai University</publisher><subject>Augmented reality ; Control ; Engineering ; Machines ; Manufacturing ; Mechatronics ; Nanotechnology and Microengineering ; Processes ; Programming ; Robotics ; Robots ; User interface ; Welding ; Workpieces</subject><ispartof>Advances in manufacturing, 2017-09, Vol.5 (3), p.191-198</ispartof><rights>The Author(s) 2017</rights><rights>Advances in Manufacturing is a copyright of Springer, 2017.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c386t-899c0404b29757dbf42cc8e1de6bb727547813abeeaf4d55ab28e3bbea2e935d3</citedby><cites>FETCH-LOGICAL-c386t-899c0404b29757dbf42cc8e1de6bb727547813abeeaf4d55ab28e3bbea2e935d3</cites><orcidid>0000-0002-1029-9988</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Uhttp://image.cqvip.com/vip1000/qk/85172A/85172A.jpg</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40436-017-0184-7$$EPDF$$P50$$Gspringer$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s40436-017-0184-7$$EHTML$$P50$$Gspringer$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Ni, D.</creatorcontrib><creatorcontrib>Yew, A. W. W.</creatorcontrib><creatorcontrib>Ong, S. K.</creatorcontrib><creatorcontrib>Nee, A. Y. C.</creatorcontrib><title>Haptic and visual augmented reality interface for programming welding robots</title><title>Advances in manufacturing</title><addtitle>Adv. Manuf</addtitle><addtitle>Advances in Manrfacturing</addtitle><description>It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming with- out prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.</description><subject>Augmented reality</subject><subject>Control</subject><subject>Engineering</subject><subject>Machines</subject><subject>Manufacturing</subject><subject>Mechatronics</subject><subject>Nanotechnology and Microengineering</subject><subject>Processes</subject><subject>Programming</subject><subject>Robotics</subject><subject>Robots</subject><subject>User interface</subject><subject>Welding</subject><subject>Workpieces</subject><issn>2095-3127</issn><issn>2195-3597</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>C6C</sourceid><sourceid>BENPR</sourceid><recordid>eNp9UEtLxDAQDqLgsu4P8Bb0XM07zVEWdYUFL3oOSTutlT52k1bZf2_KLuLJwzAzzPcYPoSuKbmjhOj7KIjgKiNUp8pFps_QglEjMy6NPk8zmWfK9CVaxdh4wtR8oWqBthu3G5sCu77EX02cXIvdVHfQj1DiAK5txgNu0hYqVwCuhoB3YaiD67qmr_E3tOXcw-CHMV6hi8q1EVanvkTvT49v6022fX1-WT9ss4LnasxyYwqSXvbMaKlLXwlWFDnQEpT3mmkpdE658wCuEqWUzrMcuPfgGBguS75Et0fd9Mp-gjjaz2EKfbK01HAjlFQ5Syh6RBVhiDFAZXeh6Vw4WErsnJs95mZTbnbOzerEYUdOTNi-hvBH-R_SzcnoY-jrfeL9OinNtTbCEP4DU_t8eQ</recordid><startdate>20170901</startdate><enddate>20170901</enddate><creator>Ni, D.</creator><creator>Yew, A. W. W.</creator><creator>Ong, S. K.</creator><creator>Nee, A. Y. C.</creator><general>Shanghai University</general><general>Springer Nature B.V</general><scope>2RA</scope><scope>92L</scope><scope>CQIGP</scope><scope>W92</scope><scope>~WA</scope><scope>C6C</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7TA</scope><scope>7TB</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>AFKRA</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>F28</scope><scope>FR3</scope><scope>HCIFZ</scope><scope>JG9</scope><scope>L6V</scope><scope>M7S</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><orcidid>https://orcid.org/0000-0002-1029-9988</orcidid></search><sort><creationdate>20170901</creationdate><title>Haptic and visual augmented reality interface for programming welding robots</title><author>Ni, D. ; Yew, A. W. W. ; Ong, S. K. ; Nee, A. Y. C.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c386t-899c0404b29757dbf42cc8e1de6bb727547813abeeaf4d55ab28e3bbea2e935d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Augmented reality</topic><topic>Control</topic><topic>Engineering</topic><topic>Machines</topic><topic>Manufacturing</topic><topic>Mechatronics</topic><topic>Nanotechnology and Microengineering</topic><topic>Processes</topic><topic>Programming</topic><topic>Robotics</topic><topic>Robots</topic><topic>User interface</topic><topic>Welding</topic><topic>Workpieces</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ni, D.</creatorcontrib><creatorcontrib>Yew, A. W. W.</creatorcontrib><creatorcontrib>Ong, S. K.</creatorcontrib><creatorcontrib>Nee, A. Y. C.</creatorcontrib><collection>维普_期刊</collection><collection>中文科技期刊数据库-CALIS站点</collection><collection>维普中文期刊数据库</collection><collection>中文科技期刊数据库-工程技术</collection><collection>中文科技期刊数据库- 镜像站点</collection><collection>SpringerOpen</collection><collection>CrossRef</collection><collection>Materials Business File</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Database (Proquest)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>SciTech Premium Collection</collection><collection>Materials Research Database</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering collection</collection><jtitle>Advances in manufacturing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ni, D.</au><au>Yew, A. W. W.</au><au>Ong, S. K.</au><au>Nee, A. Y. C.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Haptic and visual augmented reality interface for programming welding robots</atitle><jtitle>Advances in manufacturing</jtitle><stitle>Adv. Manuf</stitle><addtitle>Advances in Manrfacturing</addtitle><date>2017-09-01</date><risdate>2017</risdate><volume>5</volume><issue>3</issue><spage>191</spage><epage>198</epage><pages>191-198</pages><issn>2095-3127</issn><eissn>2195-3597</eissn><abstract>It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming with- out prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.</abstract><cop>Shanghai</cop><pub>Shanghai University</pub><doi>10.1007/s40436-017-0184-7</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0002-1029-9988</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2095-3127
ispartof Advances in manufacturing, 2017-09, Vol.5 (3), p.191-198
issn 2095-3127
2195-3597
language eng
recordid cdi_proquest_journals_1939465682
source 2022 ECC(Springer)
subjects Augmented reality
Control
Engineering
Machines
Manufacturing
Mechatronics
Nanotechnology and Microengineering
Processes
Programming
Robotics
Robots
User interface
Welding
Workpieces
title Haptic and visual augmented reality interface for programming welding robots
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T11%3A54%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Haptic%20and%20visual%20augmented%20reality%20interface%20for%20programming%20welding%20robots&rft.jtitle=Advances%20in%20manufacturing&rft.au=Ni,%20D.&rft.date=2017-09-01&rft.volume=5&rft.issue=3&rft.spage=191&rft.epage=198&rft.pages=191-198&rft.issn=2095-3127&rft.eissn=2195-3597&rft_id=info:doi/10.1007/s40436-017-0184-7&rft_dat=%3Cproquest_cross%3E1939465682%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1939465682&rft_id=info:pmid/&rft_cqvip_id=673779490&rfr_iscdi=true