Towards seamless human robot collaboration: integrating multimodal interaction
This paper discusses the challenges in the collaboration between human operators and industrial robots for assembly operations focusing on safety and simplified interaction. A case study is presented, involving perception technologies for the robot in conjunction with wearable devices used by the op...
Gespeichert in:
| Veröffentlicht in: | International journal of advanced manufacturing technology 2019-12, Vol.105 (9), p.3881-3897 |
|---|---|
| Hauptverfasser: | , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 3897 |
|---|---|
| container_issue | 9 |
| container_start_page | 3881 |
| container_title | International journal of advanced manufacturing technology |
| container_volume | 105 |
| creator | Papanastasiou, Stergios Kousi, Niki Karagiannis, Panagiotis Gkournelos, Christos Papavasileiou, Apostolis Dimoulas, Konstantinos Baris, Konstantinos Koukas, Spyridon Michalos, George Makris, Sotiris |
| description | This paper discusses the challenges in the collaboration between human operators and industrial robots for assembly operations focusing on safety and simplified interaction. A case study is presented, involving perception technologies for the robot in conjunction with wearable devices used by the operator. In terms of robot perception, a manual guidance module, an air pressor contact sensor namely skin, and a vision system for recognition and tracking of objects have been developed and integrated. Concerning the wearable devices, an advanced user interface including audio and haptic commands accompanied by augmented reality technology are used to support the operator and provide awareness by visualizing information related to production and safety aspects. In parallel, safety functionalities are implemented through collision detection technologies such as a safety skin and safety monitored regions delimiting the area of the robot activities. The complete system is coordinated under a common integration platform and it is validated in a case study of the white goods industry. |
| doi_str_mv | 10.1007/s00170-019-03790-3 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2490861651</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2490861651</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-bdd80d00f84f9219a398d9d908587f751592bcc6151b76408a7b13258d0e1b513</originalsourceid><addsrcrecordid>eNqFkM1KxDAURoMoOI6-gKuC6-hN0jSJOxn8g0E34zqkTTp2aJsxaRHf3nQquNNVuOF83-UehC4JXBMAcRMBiAAMRGFgQgFmR2hBcsYwA8KP0QJoITEThTxFZzHuEl6QQi7Qy8Z_mmBjFp3pWhdj9j52ps-CL_2QVb5tTemDGRrf32ZNP7jtNPTbrBvboem8Ne3hO5hqYs7RSW3a6C5-3iV6e7jfrJ7w-vXxeXW3xhXLxYBLayVYgFrmtaJEGaakVVaB5FLUghOuaFlVBeGkFEUO0oiSMMqlBUdKTtgSXc29--A_RhcHvfNj6NNKTfNUk477h2IUpJKUs0TRmaqCjzG4Wu9D05nwpQnoya6e7epkVx_s6inE5lBMcL914bf6j9Q3kGx8Ig</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2320898253</pqid></control><display><type>article</type><title>Towards seamless human robot collaboration: integrating multimodal interaction</title><source>SpringerNature Journals</source><creator>Papanastasiou, Stergios ; Kousi, Niki ; Karagiannis, Panagiotis ; Gkournelos, Christos ; Papavasileiou, Apostolis ; Dimoulas, Konstantinos ; Baris, Konstantinos ; Koukas, Spyridon ; Michalos, George ; Makris, Sotiris</creator><creatorcontrib>Papanastasiou, Stergios ; Kousi, Niki ; Karagiannis, Panagiotis ; Gkournelos, Christos ; Papavasileiou, Apostolis ; Dimoulas, Konstantinos ; Baris, Konstantinos ; Koukas, Spyridon ; Michalos, George ; Makris, Sotiris</creatorcontrib><description>This paper discusses the challenges in the collaboration between human operators and industrial robots for assembly operations focusing on safety and simplified interaction. A case study is presented, involving perception technologies for the robot in conjunction with wearable devices used by the operator. In terms of robot perception, a manual guidance module, an air pressor contact sensor namely skin, and a vision system for recognition and tracking of objects have been developed and integrated. Concerning the wearable devices, an advanced user interface including audio and haptic commands accompanied by augmented reality technology are used to support the operator and provide awareness by visualizing information related to production and safety aspects. In parallel, safety functionalities are implemented through collision detection technologies such as a safety skin and safety monitored regions delimiting the area of the robot activities. The complete system is coordinated under a common integration platform and it is validated in a case study of the white goods industry.</description><identifier>ISSN: 0268-3768</identifier><identifier>EISSN: 1433-3015</identifier><identifier>DOI: 10.1007/s00170-019-03790-3</identifier><language>eng</language><publisher>London: Springer London</publisher><subject>Augmented reality ; CAE) and Design ; Case studies ; Collaboration ; Computer-Aided Engineering (CAD ; Engineering ; Household appliances ; Industrial and Production Engineering ; Industrial robots ; Industrial safety ; Mechanical Engineering ; Media Management ; Object recognition ; Original Article ; Perception ; Robots ; Vision systems ; Wearable computers ; Wearable technology</subject><ispartof>International journal of advanced manufacturing technology, 2019-12, Vol.105 (9), p.3881-3897</ispartof><rights>Springer-Verlag London Ltd., part of Springer Nature 2019</rights><rights>The International Journal of Advanced Manufacturing Technology is a copyright of Springer, (2019). All Rights Reserved.</rights><rights>Springer-Verlag London Ltd., part of Springer Nature 2019.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-bdd80d00f84f9219a398d9d908587f751592bcc6151b76408a7b13258d0e1b513</citedby><cites>FETCH-LOGICAL-c347t-bdd80d00f84f9219a398d9d908587f751592bcc6151b76408a7b13258d0e1b513</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00170-019-03790-3$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00170-019-03790-3$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Papanastasiou, Stergios</creatorcontrib><creatorcontrib>Kousi, Niki</creatorcontrib><creatorcontrib>Karagiannis, Panagiotis</creatorcontrib><creatorcontrib>Gkournelos, Christos</creatorcontrib><creatorcontrib>Papavasileiou, Apostolis</creatorcontrib><creatorcontrib>Dimoulas, Konstantinos</creatorcontrib><creatorcontrib>Baris, Konstantinos</creatorcontrib><creatorcontrib>Koukas, Spyridon</creatorcontrib><creatorcontrib>Michalos, George</creatorcontrib><creatorcontrib>Makris, Sotiris</creatorcontrib><title>Towards seamless human robot collaboration: integrating multimodal interaction</title><title>International journal of advanced manufacturing technology</title><addtitle>Int J Adv Manuf Technol</addtitle><description>This paper discusses the challenges in the collaboration between human operators and industrial robots for assembly operations focusing on safety and simplified interaction. A case study is presented, involving perception technologies for the robot in conjunction with wearable devices used by the operator. In terms of robot perception, a manual guidance module, an air pressor contact sensor namely skin, and a vision system for recognition and tracking of objects have been developed and integrated. Concerning the wearable devices, an advanced user interface including audio and haptic commands accompanied by augmented reality technology are used to support the operator and provide awareness by visualizing information related to production and safety aspects. In parallel, safety functionalities are implemented through collision detection technologies such as a safety skin and safety monitored regions delimiting the area of the robot activities. The complete system is coordinated under a common integration platform and it is validated in a case study of the white goods industry.</description><subject>Augmented reality</subject><subject>CAE) and Design</subject><subject>Case studies</subject><subject>Collaboration</subject><subject>Computer-Aided Engineering (CAD</subject><subject>Engineering</subject><subject>Household appliances</subject><subject>Industrial and Production Engineering</subject><subject>Industrial robots</subject><subject>Industrial safety</subject><subject>Mechanical Engineering</subject><subject>Media Management</subject><subject>Object recognition</subject><subject>Original Article</subject><subject>Perception</subject><subject>Robots</subject><subject>Vision systems</subject><subject>Wearable computers</subject><subject>Wearable technology</subject><issn>0268-3768</issn><issn>1433-3015</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>AFKRA</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNqFkM1KxDAURoMoOI6-gKuC6-hN0jSJOxn8g0E34zqkTTp2aJsxaRHf3nQquNNVuOF83-UehC4JXBMAcRMBiAAMRGFgQgFmR2hBcsYwA8KP0QJoITEThTxFZzHuEl6QQi7Qy8Z_mmBjFp3pWhdj9j52ps-CL_2QVb5tTemDGRrf32ZNP7jtNPTbrBvboem8Ne3hO5hqYs7RSW3a6C5-3iV6e7jfrJ7w-vXxeXW3xhXLxYBLayVYgFrmtaJEGaakVVaB5FLUghOuaFlVBeGkFEUO0oiSMMqlBUdKTtgSXc29--A_RhcHvfNj6NNKTfNUk477h2IUpJKUs0TRmaqCjzG4Wu9D05nwpQnoya6e7epkVx_s6inE5lBMcL914bf6j9Q3kGx8Ig</recordid><startdate>20191201</startdate><enddate>20191201</enddate><creator>Papanastasiou, Stergios</creator><creator>Kousi, Niki</creator><creator>Karagiannis, Panagiotis</creator><creator>Gkournelos, Christos</creator><creator>Papavasileiou, Apostolis</creator><creator>Dimoulas, Konstantinos</creator><creator>Baris, Konstantinos</creator><creator>Koukas, Spyridon</creator><creator>Michalos, George</creator><creator>Makris, Sotiris</creator><general>Springer London</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>AFKRA</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20191201</creationdate><title>Towards seamless human robot collaboration: integrating multimodal interaction</title><author>Papanastasiou, Stergios ; Kousi, Niki ; Karagiannis, Panagiotis ; Gkournelos, Christos ; Papavasileiou, Apostolis ; Dimoulas, Konstantinos ; Baris, Konstantinos ; Koukas, Spyridon ; Michalos, George ; Makris, Sotiris</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-bdd80d00f84f9219a398d9d908587f751592bcc6151b76408a7b13258d0e1b513</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Augmented reality</topic><topic>CAE) and Design</topic><topic>Case studies</topic><topic>Collaboration</topic><topic>Computer-Aided Engineering (CAD</topic><topic>Engineering</topic><topic>Household appliances</topic><topic>Industrial and Production Engineering</topic><topic>Industrial robots</topic><topic>Industrial safety</topic><topic>Mechanical Engineering</topic><topic>Media Management</topic><topic>Object recognition</topic><topic>Original Article</topic><topic>Perception</topic><topic>Robots</topic><topic>Vision systems</topic><topic>Wearable computers</topic><topic>Wearable technology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Papanastasiou, Stergios</creatorcontrib><creatorcontrib>Kousi, Niki</creatorcontrib><creatorcontrib>Karagiannis, Panagiotis</creatorcontrib><creatorcontrib>Gkournelos, Christos</creatorcontrib><creatorcontrib>Papavasileiou, Apostolis</creatorcontrib><creatorcontrib>Dimoulas, Konstantinos</creatorcontrib><creatorcontrib>Baris, Konstantinos</creatorcontrib><creatorcontrib>Koukas, Spyridon</creatorcontrib><creatorcontrib>Michalos, George</creatorcontrib><creatorcontrib>Makris, Sotiris</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><jtitle>International journal of advanced manufacturing technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Papanastasiou, Stergios</au><au>Kousi, Niki</au><au>Karagiannis, Panagiotis</au><au>Gkournelos, Christos</au><au>Papavasileiou, Apostolis</au><au>Dimoulas, Konstantinos</au><au>Baris, Konstantinos</au><au>Koukas, Spyridon</au><au>Michalos, George</au><au>Makris, Sotiris</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Towards seamless human robot collaboration: integrating multimodal interaction</atitle><jtitle>International journal of advanced manufacturing technology</jtitle><stitle>Int J Adv Manuf Technol</stitle><date>2019-12-01</date><risdate>2019</risdate><volume>105</volume><issue>9</issue><spage>3881</spage><epage>3897</epage><pages>3881-3897</pages><issn>0268-3768</issn><eissn>1433-3015</eissn><abstract>This paper discusses the challenges in the collaboration between human operators and industrial robots for assembly operations focusing on safety and simplified interaction. A case study is presented, involving perception technologies for the robot in conjunction with wearable devices used by the operator. In terms of robot perception, a manual guidance module, an air pressor contact sensor namely skin, and a vision system for recognition and tracking of objects have been developed and integrated. Concerning the wearable devices, an advanced user interface including audio and haptic commands accompanied by augmented reality technology are used to support the operator and provide awareness by visualizing information related to production and safety aspects. In parallel, safety functionalities are implemented through collision detection technologies such as a safety skin and safety monitored regions delimiting the area of the robot activities. The complete system is coordinated under a common integration platform and it is validated in a case study of the white goods industry.</abstract><cop>London</cop><pub>Springer London</pub><doi>10.1007/s00170-019-03790-3</doi><tpages>17</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0268-3768 |
| ispartof | International journal of advanced manufacturing technology, 2019-12, Vol.105 (9), p.3881-3897 |
| issn | 0268-3768 1433-3015 |
| language | eng |
| recordid | cdi_proquest_journals_2490861651 |
| source | SpringerNature Journals |
| subjects | Augmented reality CAE) and Design Case studies Collaboration Computer-Aided Engineering (CAD Engineering Household appliances Industrial and Production Engineering Industrial robots Industrial safety Mechanical Engineering Media Management Object recognition Original Article Perception Robots Vision systems Wearable computers Wearable technology |
| title | Towards seamless human robot collaboration: integrating multimodal interaction |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T05%3A59%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Towards%20seamless%20human%20robot%20collaboration:%20integrating%20multimodal%20interaction&rft.jtitle=International%20journal%20of%20advanced%20manufacturing%20technology&rft.au=Papanastasiou,%20Stergios&rft.date=2019-12-01&rft.volume=105&rft.issue=9&rft.spage=3881&rft.epage=3897&rft.pages=3881-3897&rft.issn=0268-3768&rft.eissn=1433-3015&rft_id=info:doi/10.1007/s00170-019-03790-3&rft_dat=%3Cproquest_cross%3E2490861651%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2320898253&rft_id=info:pmid/&rfr_iscdi=true |