A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer
This paper describes the cybernetic avatar system developed by Team JANUS for connectivity, exploration, and skill transfer: the core domains targeted by the ANA Avatar XPRIZE competition, for which Team JANUS was a finalist. We used as an avatar a humanoid robot with a human-like appearance and sha...
Gespeichert in:
| Veröffentlicht in: | International journal of social robotics 2024-01 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | International journal of social robotics |
| container_volume | |
| creator | Cisneros-Limón, Rafael Dallard, Antonin Benallegue, Mehdi Kaneko, Kenji Kaminaga, Hiroshi Gergondet, Pierre Tanguy, Arnaud Singh, Rohan Pratap Sun, Leyuan Chen, Yang Fournier, Carole Lorthioir, Guillaume Tsuru, Masato Chefchaouni-Moussaoui, Sélim Osawa, Yukiko Caron, Guillaume Chappellet, Kevin Morisawa, Mitsuharu Escande, Adrien Ayusawa, Ko Houhou, Younes Kumagai, Iori Ono, Michio Shirasaka, Koji Wada, Shiryu Wada, Hiroshi Kanehiro, Fumio Kheddar, Abderrahmane |
| description | This paper describes the cybernetic avatar system developed by Team JANUS for connectivity, exploration, and skill transfer: the core domains targeted by the ANA Avatar XPRIZE competition, for which Team JANUS was a finalist. We used as an avatar a humanoid robot with a human-like appearance and shape that is capable of reproducing facial expressions and walking, and built an avatar control system that allowed the operator to control the avatar through equivalent mechanisms of motion; that is, by replicating the upper-body movement with naturalness and by stepping to command locomotion. In this way, we aimed to achieve high-fidelity telepresence and managed to be well evaluated from the point of view of the operator during the competition. We introduce our solutions to the integration challenges and present experimental results to asses our avatar system, together with current limitations and how we are planning to mitigate them in future work. |
| doi_str_mv | 10.1007/s12369-023-01096-9 |
| format | Article |
| fullrecord | <record><control><sourceid>hal_cross</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_04425539v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>oai_HAL_hal_04425539v1</sourcerecordid><originalsourceid>FETCH-LOGICAL-c325t-909c0a600e022961df876be18f9c67ea1bd93a3f6d44d0c0e05f8616eadcc9eb3</originalsourceid><addsrcrecordid>eNo9kMtOwzAQRS0EElXpD7DyFqkBPxInXkZVoUiVWLSsLccZC0NiV3aoyN-TUmA2MxqdexcHoVtK7ikh5UOijAuZEcYzQokUmbxAM1qVRZZXpLj8u0tJr9EipXcyDWdlWYoZcjVejQ1ED4MzuD7qQUe8G9MAPR4CXvdNaEe8-ey1x3vo4BAhgTeAbYh4FbwHM7ijG8YlXn8duhD14IJfYu1bvPtwXYf3UftkId6gK6u7BIvfPUevj-v9apNtX56eV_U2M5wVQyaJNEQLQoAwJgVtbVWKBmhlpRElaNq0kmtuRZvnLTETVthKUAG6NUZCw-fo7tz7pjt1iK7XcVRBO7Wpt-r0I3nOioLLI51YdmZNDClFsP8BStTJrTq7VZNb9eNWSf4Nir9s7A</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer</title><source>Springer Nature - Complete Springer Journals</source><creator>Cisneros-Limón, Rafael ; Dallard, Antonin ; Benallegue, Mehdi ; Kaneko, Kenji ; Kaminaga, Hiroshi ; Gergondet, Pierre ; Tanguy, Arnaud ; Singh, Rohan Pratap ; Sun, Leyuan ; Chen, Yang ; Fournier, Carole ; Lorthioir, Guillaume ; Tsuru, Masato ; Chefchaouni-Moussaoui, Sélim ; Osawa, Yukiko ; Caron, Guillaume ; Chappellet, Kevin ; Morisawa, Mitsuharu ; Escande, Adrien ; Ayusawa, Ko ; Houhou, Younes ; Kumagai, Iori ; Ono, Michio ; Shirasaka, Koji ; Wada, Shiryu ; Wada, Hiroshi ; Kanehiro, Fumio ; Kheddar, Abderrahmane</creator><creatorcontrib>Cisneros-Limón, Rafael ; Dallard, Antonin ; Benallegue, Mehdi ; Kaneko, Kenji ; Kaminaga, Hiroshi ; Gergondet, Pierre ; Tanguy, Arnaud ; Singh, Rohan Pratap ; Sun, Leyuan ; Chen, Yang ; Fournier, Carole ; Lorthioir, Guillaume ; Tsuru, Masato ; Chefchaouni-Moussaoui, Sélim ; Osawa, Yukiko ; Caron, Guillaume ; Chappellet, Kevin ; Morisawa, Mitsuharu ; Escande, Adrien ; Ayusawa, Ko ; Houhou, Younes ; Kumagai, Iori ; Ono, Michio ; Shirasaka, Koji ; Wada, Shiryu ; Wada, Hiroshi ; Kanehiro, Fumio ; Kheddar, Abderrahmane</creatorcontrib><description>This paper describes the cybernetic avatar system developed by Team JANUS for connectivity, exploration, and skill transfer: the core domains targeted by the ANA Avatar XPRIZE competition, for which Team JANUS was a finalist. We used as an avatar a humanoid robot with a human-like appearance and shape that is capable of reproducing facial expressions and walking, and built an avatar control system that allowed the operator to control the avatar through equivalent mechanisms of motion; that is, by replicating the upper-body movement with naturalness and by stepping to command locomotion. In this way, we aimed to achieve high-fidelity telepresence and managed to be well evaluated from the point of view of the operator during the competition. We introduce our solutions to the integration challenges and present experimental results to asses our avatar system, together with current limitations and how we are planning to mitigate them in future work.</description><identifier>ISSN: 1875-4791</identifier><identifier>EISSN: 1875-4805</identifier><identifier>DOI: 10.1007/s12369-023-01096-9</identifier><language>eng</language><publisher>Springer</publisher><subject>Computer Science ; Robotics</subject><ispartof>International journal of social robotics, 2024-01</ispartof><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c325t-909c0a600e022961df876be18f9c67ea1bd93a3f6d44d0c0e05f8616eadcc9eb3</citedby><cites>FETCH-LOGICAL-c325t-909c0a600e022961df876be18f9c67ea1bd93a3f6d44d0c0e05f8616eadcc9eb3</cites><orcidid>0000-0002-0850-070X ; 0000-0002-0395-5799 ; 0000-0002-0277-3467 ; 0000-0003-2931-1032 ; 0000-0003-3703-2973 ; 0000-0001-8041-3160 ; 0000-0001-7537-9498 ; 0000-0003-4925-2519 ; 0000-0002-1888-8787 ; 0000-0003-3844-7986 ; 0000-0002-4309-1972 ; 0000-0002-2569-5852 ; 0000-0001-9033-9742 ; 0000-0002-8288-7973 ; 0000-0003-4204-4282 ; 0000-0003-0056-4335</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,776,780,881,27901,27902</link.rule.ids><backlink>$$Uhttps://hal.science/hal-04425539$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Cisneros-Limón, Rafael</creatorcontrib><creatorcontrib>Dallard, Antonin</creatorcontrib><creatorcontrib>Benallegue, Mehdi</creatorcontrib><creatorcontrib>Kaneko, Kenji</creatorcontrib><creatorcontrib>Kaminaga, Hiroshi</creatorcontrib><creatorcontrib>Gergondet, Pierre</creatorcontrib><creatorcontrib>Tanguy, Arnaud</creatorcontrib><creatorcontrib>Singh, Rohan Pratap</creatorcontrib><creatorcontrib>Sun, Leyuan</creatorcontrib><creatorcontrib>Chen, Yang</creatorcontrib><creatorcontrib>Fournier, Carole</creatorcontrib><creatorcontrib>Lorthioir, Guillaume</creatorcontrib><creatorcontrib>Tsuru, Masato</creatorcontrib><creatorcontrib>Chefchaouni-Moussaoui, Sélim</creatorcontrib><creatorcontrib>Osawa, Yukiko</creatorcontrib><creatorcontrib>Caron, Guillaume</creatorcontrib><creatorcontrib>Chappellet, Kevin</creatorcontrib><creatorcontrib>Morisawa, Mitsuharu</creatorcontrib><creatorcontrib>Escande, Adrien</creatorcontrib><creatorcontrib>Ayusawa, Ko</creatorcontrib><creatorcontrib>Houhou, Younes</creatorcontrib><creatorcontrib>Kumagai, Iori</creatorcontrib><creatorcontrib>Ono, Michio</creatorcontrib><creatorcontrib>Shirasaka, Koji</creatorcontrib><creatorcontrib>Wada, Shiryu</creatorcontrib><creatorcontrib>Wada, Hiroshi</creatorcontrib><creatorcontrib>Kanehiro, Fumio</creatorcontrib><creatorcontrib>Kheddar, Abderrahmane</creatorcontrib><title>A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer</title><title>International journal of social robotics</title><description>This paper describes the cybernetic avatar system developed by Team JANUS for connectivity, exploration, and skill transfer: the core domains targeted by the ANA Avatar XPRIZE competition, for which Team JANUS was a finalist. We used as an avatar a humanoid robot with a human-like appearance and shape that is capable of reproducing facial expressions and walking, and built an avatar control system that allowed the operator to control the avatar through equivalent mechanisms of motion; that is, by replicating the upper-body movement with naturalness and by stepping to command locomotion. In this way, we aimed to achieve high-fidelity telepresence and managed to be well evaluated from the point of view of the operator during the competition. We introduce our solutions to the integration challenges and present experimental results to asses our avatar system, together with current limitations and how we are planning to mitigate them in future work.</description><subject>Computer Science</subject><subject>Robotics</subject><issn>1875-4791</issn><issn>1875-4805</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNo9kMtOwzAQRS0EElXpD7DyFqkBPxInXkZVoUiVWLSsLccZC0NiV3aoyN-TUmA2MxqdexcHoVtK7ikh5UOijAuZEcYzQokUmbxAM1qVRZZXpLj8u0tJr9EipXcyDWdlWYoZcjVejQ1ED4MzuD7qQUe8G9MAPR4CXvdNaEe8-ey1x3vo4BAhgTeAbYh4FbwHM7ijG8YlXn8duhD14IJfYu1bvPtwXYf3UftkId6gK6u7BIvfPUevj-v9apNtX56eV_U2M5wVQyaJNEQLQoAwJgVtbVWKBmhlpRElaNq0kmtuRZvnLTETVthKUAG6NUZCw-fo7tz7pjt1iK7XcVRBO7Wpt-r0I3nOioLLI51YdmZNDClFsP8BStTJrTq7VZNb9eNWSf4Nir9s7A</recordid><startdate>20240129</startdate><enddate>20240129</enddate><creator>Cisneros-Limón, Rafael</creator><creator>Dallard, Antonin</creator><creator>Benallegue, Mehdi</creator><creator>Kaneko, Kenji</creator><creator>Kaminaga, Hiroshi</creator><creator>Gergondet, Pierre</creator><creator>Tanguy, Arnaud</creator><creator>Singh, Rohan Pratap</creator><creator>Sun, Leyuan</creator><creator>Chen, Yang</creator><creator>Fournier, Carole</creator><creator>Lorthioir, Guillaume</creator><creator>Tsuru, Masato</creator><creator>Chefchaouni-Moussaoui, Sélim</creator><creator>Osawa, Yukiko</creator><creator>Caron, Guillaume</creator><creator>Chappellet, Kevin</creator><creator>Morisawa, Mitsuharu</creator><creator>Escande, Adrien</creator><creator>Ayusawa, Ko</creator><creator>Houhou, Younes</creator><creator>Kumagai, Iori</creator><creator>Ono, Michio</creator><creator>Shirasaka, Koji</creator><creator>Wada, Shiryu</creator><creator>Wada, Hiroshi</creator><creator>Kanehiro, Fumio</creator><creator>Kheddar, Abderrahmane</creator><general>Springer</general><scope>AAYXX</scope><scope>CITATION</scope><scope>1XC</scope><scope>VOOES</scope><orcidid>https://orcid.org/0000-0002-0850-070X</orcidid><orcidid>https://orcid.org/0000-0002-0395-5799</orcidid><orcidid>https://orcid.org/0000-0002-0277-3467</orcidid><orcidid>https://orcid.org/0000-0003-2931-1032</orcidid><orcidid>https://orcid.org/0000-0003-3703-2973</orcidid><orcidid>https://orcid.org/0000-0001-8041-3160</orcidid><orcidid>https://orcid.org/0000-0001-7537-9498</orcidid><orcidid>https://orcid.org/0000-0003-4925-2519</orcidid><orcidid>https://orcid.org/0000-0002-1888-8787</orcidid><orcidid>https://orcid.org/0000-0003-3844-7986</orcidid><orcidid>https://orcid.org/0000-0002-4309-1972</orcidid><orcidid>https://orcid.org/0000-0002-2569-5852</orcidid><orcidid>https://orcid.org/0000-0001-9033-9742</orcidid><orcidid>https://orcid.org/0000-0002-8288-7973</orcidid><orcidid>https://orcid.org/0000-0003-4204-4282</orcidid><orcidid>https://orcid.org/0000-0003-0056-4335</orcidid></search><sort><creationdate>20240129</creationdate><title>A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer</title><author>Cisneros-Limón, Rafael ; Dallard, Antonin ; Benallegue, Mehdi ; Kaneko, Kenji ; Kaminaga, Hiroshi ; Gergondet, Pierre ; Tanguy, Arnaud ; Singh, Rohan Pratap ; Sun, Leyuan ; Chen, Yang ; Fournier, Carole ; Lorthioir, Guillaume ; Tsuru, Masato ; Chefchaouni-Moussaoui, Sélim ; Osawa, Yukiko ; Caron, Guillaume ; Chappellet, Kevin ; Morisawa, Mitsuharu ; Escande, Adrien ; Ayusawa, Ko ; Houhou, Younes ; Kumagai, Iori ; Ono, Michio ; Shirasaka, Koji ; Wada, Shiryu ; Wada, Hiroshi ; Kanehiro, Fumio ; Kheddar, Abderrahmane</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c325t-909c0a600e022961df876be18f9c67ea1bd93a3f6d44d0c0e05f8616eadcc9eb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science</topic><topic>Robotics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Cisneros-Limón, Rafael</creatorcontrib><creatorcontrib>Dallard, Antonin</creatorcontrib><creatorcontrib>Benallegue, Mehdi</creatorcontrib><creatorcontrib>Kaneko, Kenji</creatorcontrib><creatorcontrib>Kaminaga, Hiroshi</creatorcontrib><creatorcontrib>Gergondet, Pierre</creatorcontrib><creatorcontrib>Tanguy, Arnaud</creatorcontrib><creatorcontrib>Singh, Rohan Pratap</creatorcontrib><creatorcontrib>Sun, Leyuan</creatorcontrib><creatorcontrib>Chen, Yang</creatorcontrib><creatorcontrib>Fournier, Carole</creatorcontrib><creatorcontrib>Lorthioir, Guillaume</creatorcontrib><creatorcontrib>Tsuru, Masato</creatorcontrib><creatorcontrib>Chefchaouni-Moussaoui, Sélim</creatorcontrib><creatorcontrib>Osawa, Yukiko</creatorcontrib><creatorcontrib>Caron, Guillaume</creatorcontrib><creatorcontrib>Chappellet, Kevin</creatorcontrib><creatorcontrib>Morisawa, Mitsuharu</creatorcontrib><creatorcontrib>Escande, Adrien</creatorcontrib><creatorcontrib>Ayusawa, Ko</creatorcontrib><creatorcontrib>Houhou, Younes</creatorcontrib><creatorcontrib>Kumagai, Iori</creatorcontrib><creatorcontrib>Ono, Michio</creatorcontrib><creatorcontrib>Shirasaka, Koji</creatorcontrib><creatorcontrib>Wada, Shiryu</creatorcontrib><creatorcontrib>Wada, Hiroshi</creatorcontrib><creatorcontrib>Kanehiro, Fumio</creatorcontrib><creatorcontrib>Kheddar, Abderrahmane</creatorcontrib><collection>CrossRef</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>International journal of social robotics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Cisneros-Limón, Rafael</au><au>Dallard, Antonin</au><au>Benallegue, Mehdi</au><au>Kaneko, Kenji</au><au>Kaminaga, Hiroshi</au><au>Gergondet, Pierre</au><au>Tanguy, Arnaud</au><au>Singh, Rohan Pratap</au><au>Sun, Leyuan</au><au>Chen, Yang</au><au>Fournier, Carole</au><au>Lorthioir, Guillaume</au><au>Tsuru, Masato</au><au>Chefchaouni-Moussaoui, Sélim</au><au>Osawa, Yukiko</au><au>Caron, Guillaume</au><au>Chappellet, Kevin</au><au>Morisawa, Mitsuharu</au><au>Escande, Adrien</au><au>Ayusawa, Ko</au><au>Houhou, Younes</au><au>Kumagai, Iori</au><au>Ono, Michio</au><au>Shirasaka, Koji</au><au>Wada, Shiryu</au><au>Wada, Hiroshi</au><au>Kanehiro, Fumio</au><au>Kheddar, Abderrahmane</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer</atitle><jtitle>International journal of social robotics</jtitle><date>2024-01-29</date><risdate>2024</risdate><issn>1875-4791</issn><eissn>1875-4805</eissn><abstract>This paper describes the cybernetic avatar system developed by Team JANUS for connectivity, exploration, and skill transfer: the core domains targeted by the ANA Avatar XPRIZE competition, for which Team JANUS was a finalist. We used as an avatar a humanoid robot with a human-like appearance and shape that is capable of reproducing facial expressions and walking, and built an avatar control system that allowed the operator to control the avatar through equivalent mechanisms of motion; that is, by replicating the upper-body movement with naturalness and by stepping to command locomotion. In this way, we aimed to achieve high-fidelity telepresence and managed to be well evaluated from the point of view of the operator during the competition. We introduce our solutions to the integration challenges and present experimental results to asses our avatar system, together with current limitations and how we are planning to mitigate them in future work.</abstract><pub>Springer</pub><doi>10.1007/s12369-023-01096-9</doi><orcidid>https://orcid.org/0000-0002-0850-070X</orcidid><orcidid>https://orcid.org/0000-0002-0395-5799</orcidid><orcidid>https://orcid.org/0000-0002-0277-3467</orcidid><orcidid>https://orcid.org/0000-0003-2931-1032</orcidid><orcidid>https://orcid.org/0000-0003-3703-2973</orcidid><orcidid>https://orcid.org/0000-0001-8041-3160</orcidid><orcidid>https://orcid.org/0000-0001-7537-9498</orcidid><orcidid>https://orcid.org/0000-0003-4925-2519</orcidid><orcidid>https://orcid.org/0000-0002-1888-8787</orcidid><orcidid>https://orcid.org/0000-0003-3844-7986</orcidid><orcidid>https://orcid.org/0000-0002-4309-1972</orcidid><orcidid>https://orcid.org/0000-0002-2569-5852</orcidid><orcidid>https://orcid.org/0000-0001-9033-9742</orcidid><orcidid>https://orcid.org/0000-0002-8288-7973</orcidid><orcidid>https://orcid.org/0000-0003-4204-4282</orcidid><orcidid>https://orcid.org/0000-0003-0056-4335</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1875-4791 |
| ispartof | International journal of social robotics, 2024-01 |
| issn | 1875-4791 1875-4805 |
| language | eng |
| recordid | cdi_hal_primary_oai_HAL_hal_04425539v1 |
| source | Springer Nature - Complete Springer Journals |
| subjects | Computer Science Robotics |
| title | A Cybernetic Avatar System to Embody Human Telepresence for Connectivity, Exploration, and Skill Transfer |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-30T23%3A18%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-hal_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Cybernetic%20Avatar%20System%20to%20Embody%20Human%20Telepresence%20for%20Connectivity,%20Exploration,%20and%20Skill%20Transfer&rft.jtitle=International%20journal%20of%20social%20robotics&rft.au=Cisneros-Lim%C3%B3n,%20Rafael&rft.date=2024-01-29&rft.issn=1875-4791&rft.eissn=1875-4805&rft_id=info:doi/10.1007/s12369-023-01096-9&rft_dat=%3Chal_cross%3Eoai_HAL_hal_04425539v1%3C/hal_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |