Shape Visual Servoing of a Cable Suspended Between Two Drones
In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the seco...
Gespeichert in:
Veröffentlicht in: | IEEE robotics and automation letters 2024-12, Vol.9 (12), p.11473-11480 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 11480 |
---|---|
container_issue | 12 |
container_start_page | 11473 |
container_title | IEEE robotics and automation letters |
container_volume | 9 |
creator | Smolentsev, Lev Krupa, Alexandre Chaumette, Francois |
description | In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location. |
doi_str_mv | 10.1109/LRA.2024.3494655 |
format | Article |
fullrecord | <record><control><sourceid>hal_RIE</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_04763696v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10747267</ieee_id><sourcerecordid>oai_HAL_hal_04763696v1</sourcerecordid><originalsourceid>FETCH-LOGICAL-c181t-82dd06de80f11b7edfd5e65f8cd77ed94048518b2d277df29163d881cd3a7ab53</originalsourceid><addsrcrecordid>eNpNkDtPwzAURi0EElXpzsDglSHFbzsDQyiPIkVCooXVcuJrGhSSKO5D_HtStUKd7r2fzneHg9A1JVNKSXqXv2dTRpiYcpEKJeUZGjGudcK1Uucn-yWaxPhNCKGSaZ7KEbpfrFwH-LOKG1fjBfTbtmq-cBuwwzNX1IAXm9hB48HjB1jvABq83LX4sW8biFfoIrg6wuQ4x-jj-Wk5myf528vrLMuTkhq6TgzznigPhgRKCw0-eAlKBlN6PVypIMJIagrmmdY-sJQq7o2hpedOu0LyMbo9_F252nZ99eP6X9u6ys6z3O4zIrTiKlVbOrDkwJZ9G2MP4b9Aid3bsoMtu7dlj7aGys2hUgHACa6FZkrzP2F2ZCg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><source>IEEE Electronic Library (IEL)</source><creator>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</creator><creatorcontrib>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</creatorcontrib><description>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</description><identifier>ISSN: 2377-3766</identifier><identifier>EISSN: 2377-3766</identifier><identifier>DOI: 10.1109/LRA.2024.3494655</identifier><identifier>CODEN: IRALC6</identifier><language>eng</language><publisher>IEEE</publisher><subject>aerial systems: perception and autonomy ; Autonomous aerial vehicles ; Cameras ; Communication cables ; Computer Science ; Drones ; Extremities ; Power cables ; Quadrotors ; Robotics ; Visual servoing ; Visualization</subject><ispartof>IEEE robotics and automation letters, 2024-12, Vol.9 (12), p.11473-11480</ispartof><rights>Attribution</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0009-0005-8319-9899 ; 0000-0002-1238-4385 ; 0000-0001-9981-8694</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10747267$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,780,784,796,885,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10747267$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://hal.science/hal-04763696$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Smolentsev, Lev</creatorcontrib><creatorcontrib>Krupa, Alexandre</creatorcontrib><creatorcontrib>Chaumette, Francois</creatorcontrib><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><title>IEEE robotics and automation letters</title><addtitle>LRA</addtitle><description>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</description><subject>aerial systems: perception and autonomy</subject><subject>Autonomous aerial vehicles</subject><subject>Cameras</subject><subject>Communication cables</subject><subject>Computer Science</subject><subject>Drones</subject><subject>Extremities</subject><subject>Power cables</subject><subject>Quadrotors</subject><subject>Robotics</subject><subject>Visual servoing</subject><subject>Visualization</subject><issn>2377-3766</issn><issn>2377-3766</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkDtPwzAURi0EElXpzsDglSHFbzsDQyiPIkVCooXVcuJrGhSSKO5D_HtStUKd7r2fzneHg9A1JVNKSXqXv2dTRpiYcpEKJeUZGjGudcK1Uucn-yWaxPhNCKGSaZ7KEbpfrFwH-LOKG1fjBfTbtmq-cBuwwzNX1IAXm9hB48HjB1jvABq83LX4sW8biFfoIrg6wuQ4x-jj-Wk5myf528vrLMuTkhq6TgzznigPhgRKCw0-eAlKBlN6PVypIMJIagrmmdY-sJQq7o2hpedOu0LyMbo9_F252nZ99eP6X9u6ys6z3O4zIrTiKlVbOrDkwJZ9G2MP4b9Aid3bsoMtu7dlj7aGys2hUgHACa6FZkrzP2F2ZCg</recordid><startdate>202412</startdate><enddate>202412</enddate><creator>Smolentsev, Lev</creator><creator>Krupa, Alexandre</creator><creator>Chaumette, Francois</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>1XC</scope><scope>VOOES</scope><orcidid>https://orcid.org/0009-0005-8319-9899</orcidid><orcidid>https://orcid.org/0000-0002-1238-4385</orcidid><orcidid>https://orcid.org/0000-0001-9981-8694</orcidid></search><sort><creationdate>202412</creationdate><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><author>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c181t-82dd06de80f11b7edfd5e65f8cd77ed94048518b2d277df29163d881cd3a7ab53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>aerial systems: perception and autonomy</topic><topic>Autonomous aerial vehicles</topic><topic>Cameras</topic><topic>Communication cables</topic><topic>Computer Science</topic><topic>Drones</topic><topic>Extremities</topic><topic>Power cables</topic><topic>Quadrotors</topic><topic>Robotics</topic><topic>Visual servoing</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Smolentsev, Lev</creatorcontrib><creatorcontrib>Krupa, Alexandre</creatorcontrib><creatorcontrib>Chaumette, Francois</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>IEEE robotics and automation letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Smolentsev, Lev</au><au>Krupa, Alexandre</au><au>Chaumette, Francois</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Shape Visual Servoing of a Cable Suspended Between Two Drones</atitle><jtitle>IEEE robotics and automation letters</jtitle><stitle>LRA</stitle><date>2024-12</date><risdate>2024</risdate><volume>9</volume><issue>12</issue><spage>11473</spage><epage>11480</epage><pages>11473-11480</pages><issn>2377-3766</issn><eissn>2377-3766</eissn><coden>IRALC6</coden><abstract>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</abstract><pub>IEEE</pub><doi>10.1109/LRA.2024.3494655</doi><tpages>8</tpages><orcidid>https://orcid.org/0009-0005-8319-9899</orcidid><orcidid>https://orcid.org/0000-0002-1238-4385</orcidid><orcidid>https://orcid.org/0000-0001-9981-8694</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2377-3766 |
ispartof | IEEE robotics and automation letters, 2024-12, Vol.9 (12), p.11473-11480 |
issn | 2377-3766 2377-3766 |
language | eng |
recordid | cdi_hal_primary_oai_HAL_hal_04763696v1 |
source | IEEE Electronic Library (IEL) |
subjects | aerial systems: perception and autonomy Autonomous aerial vehicles Cameras Communication cables Computer Science Drones Extremities Power cables Quadrotors Robotics Visual servoing Visualization |
title | Shape Visual Servoing of a Cable Suspended Between Two Drones |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T13%3A16%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-hal_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Shape%20Visual%20Servoing%20of%20a%20Cable%20Suspended%20Between%20Two%20Drones&rft.jtitle=IEEE%20robotics%20and%20automation%20letters&rft.au=Smolentsev,%20Lev&rft.date=2024-12&rft.volume=9&rft.issue=12&rft.spage=11473&rft.epage=11480&rft.pages=11473-11480&rft.issn=2377-3766&rft.eissn=2377-3766&rft.coden=IRALC6&rft_id=info:doi/10.1109/LRA.2024.3494655&rft_dat=%3Chal_RIE%3Eoai_HAL_hal_04763696v1%3C/hal_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10747267&rfr_iscdi=true |