Revisiting Proprioceptive Sensing for Articulated Object Manipulation

IEEE International Conference on Robotics and Automation 2O23 (ICRA 2023) - workshop Embracing Contacts Robots that assist humans will need to interact with articulated objects such as cabinets or microwaves. Early work on creating systems for doing so used proprioceptive sensing to estimate joint m...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lips, Thomas, wyffels, Francis
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Lips, Thomas
wyffels, Francis
description IEEE International Conference on Robotics and Automation 2O23 (ICRA 2023) - workshop Embracing Contacts Robots that assist humans will need to interact with articulated objects such as cabinets or microwaves. Early work on creating systems for doing so used proprioceptive sensing to estimate joint mechanisms during contact. However, nowadays, almost all systems use only vision and no longer consider proprioceptive information during contact. We believe that proprioceptive information during contact is a valuable source of information and did not find clear motivation for not using it in the literature. Therefore, in this paper, we create a system that, starting from a given grasp, uses proprioceptive sensing to open cabinets with a position-controlled robot and a parallel gripper. We perform a qualitative evaluation of this system, where we find that slip between the gripper and handle limits the performance. Nonetheless, we find that the system already performs quite well. This poses the question: should we make more use of proprioceptive information during contact in articulated object manipulation systems, or is it not worth the added complexity, and can we manage with vision alone? We do not have an answer to this question, but we hope to spark some discussion on the matter. The codebase and videos of the system are available at https://tlpss.github.io/revisiting-proprioception-for-articulated-manipulation/.
doi_str_mv 10.48550/arxiv.2305.09584
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2305_09584</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2305_09584</sourcerecordid><originalsourceid>FETCH-LOGICAL-a674-d0f5dd2f45812b5902de3a7363629e1ae754095cdfdd500ce9531db1419894823</originalsourceid><addsrcrecordid>eNotj71OwzAURr0woNIHYMIvkOC_m9hjVZWCVFQE3SPHvkZGJYkcNypvT1OYPukMn84h5J6zUmkA9mjTOU6lkAxKZkCrW7J5xymOMcfuk76lfkixdzjkOCH9wG6ccegTXaUc3eloM3q6b7_QZfpquzjMKPbdHbkJ9jji8n8X5PC0Oayfi91--7Je7Qpb1arwLID3IijQXLRgmPAobS0rWQmD3GIN6qLlfPAeGHNoQHLfcsWNNkoLuSAPf7fXjuYi-23TTzP3NNce-Qspq0Xh</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Revisiting Proprioceptive Sensing for Articulated Object Manipulation</title><source>arXiv.org</source><creator>Lips, Thomas ; wyffels, Francis</creator><creatorcontrib>Lips, Thomas ; wyffels, Francis</creatorcontrib><description>IEEE International Conference on Robotics and Automation 2O23 (ICRA 2023) - workshop Embracing Contacts Robots that assist humans will need to interact with articulated objects such as cabinets or microwaves. Early work on creating systems for doing so used proprioceptive sensing to estimate joint mechanisms during contact. However, nowadays, almost all systems use only vision and no longer consider proprioceptive information during contact. We believe that proprioceptive information during contact is a valuable source of information and did not find clear motivation for not using it in the literature. Therefore, in this paper, we create a system that, starting from a given grasp, uses proprioceptive sensing to open cabinets with a position-controlled robot and a parallel gripper. We perform a qualitative evaluation of this system, where we find that slip between the gripper and handle limits the performance. Nonetheless, we find that the system already performs quite well. This poses the question: should we make more use of proprioceptive information during contact in articulated object manipulation systems, or is it not worth the added complexity, and can we manage with vision alone? We do not have an answer to this question, but we hope to spark some discussion on the matter. The codebase and videos of the system are available at https://tlpss.github.io/revisiting-proprioception-for-articulated-manipulation/.</description><identifier>DOI: 10.48550/arxiv.2305.09584</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Robotics</subject><creationdate>2023-05</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2305.09584$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2305.09584$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Lips, Thomas</creatorcontrib><creatorcontrib>wyffels, Francis</creatorcontrib><title>Revisiting Proprioceptive Sensing for Articulated Object Manipulation</title><description>IEEE International Conference on Robotics and Automation 2O23 (ICRA 2023) - workshop Embracing Contacts Robots that assist humans will need to interact with articulated objects such as cabinets or microwaves. Early work on creating systems for doing so used proprioceptive sensing to estimate joint mechanisms during contact. However, nowadays, almost all systems use only vision and no longer consider proprioceptive information during contact. We believe that proprioceptive information during contact is a valuable source of information and did not find clear motivation for not using it in the literature. Therefore, in this paper, we create a system that, starting from a given grasp, uses proprioceptive sensing to open cabinets with a position-controlled robot and a parallel gripper. We perform a qualitative evaluation of this system, where we find that slip between the gripper and handle limits the performance. Nonetheless, we find that the system already performs quite well. This poses the question: should we make more use of proprioceptive information during contact in articulated object manipulation systems, or is it not worth the added complexity, and can we manage with vision alone? We do not have an answer to this question, but we hope to spark some discussion on the matter. The codebase and videos of the system are available at https://tlpss.github.io/revisiting-proprioception-for-articulated-manipulation/.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Robotics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr0woNIHYMIvkOC_m9hjVZWCVFQE3SPHvkZGJYkcNypvT1OYPukMn84h5J6zUmkA9mjTOU6lkAxKZkCrW7J5xymOMcfuk76lfkixdzjkOCH9wG6ccegTXaUc3eloM3q6b7_QZfpquzjMKPbdHbkJ9jji8n8X5PC0Oayfi91--7Je7Qpb1arwLID3IijQXLRgmPAobS0rWQmD3GIN6qLlfPAeGHNoQHLfcsWNNkoLuSAPf7fXjuYi-23TTzP3NNce-Qspq0Xh</recordid><startdate>20230516</startdate><enddate>20230516</enddate><creator>Lips, Thomas</creator><creator>wyffels, Francis</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230516</creationdate><title>Revisiting Proprioceptive Sensing for Articulated Object Manipulation</title><author>Lips, Thomas ; wyffels, Francis</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a674-d0f5dd2f45812b5902de3a7363629e1ae754095cdfdd500ce9531db1419894823</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Robotics</topic><toplevel>online_resources</toplevel><creatorcontrib>Lips, Thomas</creatorcontrib><creatorcontrib>wyffels, Francis</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Lips, Thomas</au><au>wyffels, Francis</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Revisiting Proprioceptive Sensing for Articulated Object Manipulation</atitle><date>2023-05-16</date><risdate>2023</risdate><abstract>IEEE International Conference on Robotics and Automation 2O23 (ICRA 2023) - workshop Embracing Contacts Robots that assist humans will need to interact with articulated objects such as cabinets or microwaves. Early work on creating systems for doing so used proprioceptive sensing to estimate joint mechanisms during contact. However, nowadays, almost all systems use only vision and no longer consider proprioceptive information during contact. We believe that proprioceptive information during contact is a valuable source of information and did not find clear motivation for not using it in the literature. Therefore, in this paper, we create a system that, starting from a given grasp, uses proprioceptive sensing to open cabinets with a position-controlled robot and a parallel gripper. We perform a qualitative evaluation of this system, where we find that slip between the gripper and handle limits the performance. Nonetheless, we find that the system already performs quite well. This poses the question: should we make more use of proprioceptive information during contact in articulated object manipulation systems, or is it not worth the added complexity, and can we manage with vision alone? We do not have an answer to this question, but we hope to spark some discussion on the matter. The codebase and videos of the system are available at https://tlpss.github.io/revisiting-proprioception-for-articulated-manipulation/.</abstract><doi>10.48550/arxiv.2305.09584</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2305.09584
ispartof
issn
language eng
recordid cdi_arxiv_primary_2305_09584
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Robotics
title Revisiting Proprioceptive Sensing for Articulated Object Manipulation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-13T18%3A11%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Revisiting%20Proprioceptive%20Sensing%20for%20Articulated%20Object%20Manipulation&rft.au=Lips,%20Thomas&rft.date=2023-05-16&rft_id=info:doi/10.48550/arxiv.2305.09584&rft_dat=%3Carxiv_GOX%3E2305_09584%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true