Shape Visual Servoing of a Cable Suspended Between Two Drones

In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the seco...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE robotics and automation letters 2024-12, Vol.9 (12), p.11473-11480
Hauptverfasser: Smolentsev, Lev, Krupa, Alexandre, Chaumette, Francois
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 11480
container_issue 12
container_start_page 11473
container_title IEEE robotics and automation letters
container_volume 9
creator Smolentsev, Lev
Krupa, Alexandre
Chaumette, Francois
description In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.
doi_str_mv 10.1109/LRA.2024.3494655
format Article
fullrecord <record><control><sourceid>hal_RIE</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_04763696v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10747267</ieee_id><sourcerecordid>oai_HAL_hal_04763696v1</sourcerecordid><originalsourceid>FETCH-LOGICAL-c181t-82dd06de80f11b7edfd5e65f8cd77ed94048518b2d277df29163d881cd3a7ab53</originalsourceid><addsrcrecordid>eNpNkDtPwzAURi0EElXpzsDglSHFbzsDQyiPIkVCooXVcuJrGhSSKO5D_HtStUKd7r2fzneHg9A1JVNKSXqXv2dTRpiYcpEKJeUZGjGudcK1Uucn-yWaxPhNCKGSaZ7KEbpfrFwH-LOKG1fjBfTbtmq-cBuwwzNX1IAXm9hB48HjB1jvABq83LX4sW8biFfoIrg6wuQ4x-jj-Wk5myf528vrLMuTkhq6TgzznigPhgRKCw0-eAlKBlN6PVypIMJIagrmmdY-sJQq7o2hpedOu0LyMbo9_F252nZ99eP6X9u6ys6z3O4zIrTiKlVbOrDkwJZ9G2MP4b9Aid3bsoMtu7dlj7aGys2hUgHACa6FZkrzP2F2ZCg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><source>IEEE Electronic Library (IEL)</source><creator>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</creator><creatorcontrib>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</creatorcontrib><description>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</description><identifier>ISSN: 2377-3766</identifier><identifier>EISSN: 2377-3766</identifier><identifier>DOI: 10.1109/LRA.2024.3494655</identifier><identifier>CODEN: IRALC6</identifier><language>eng</language><publisher>IEEE</publisher><subject>aerial systems: perception and autonomy ; Autonomous aerial vehicles ; Cameras ; Communication cables ; Computer Science ; Drones ; Extremities ; Power cables ; Quadrotors ; Robotics ; Visual servoing ; Visualization</subject><ispartof>IEEE robotics and automation letters, 2024-12, Vol.9 (12), p.11473-11480</ispartof><rights>Attribution</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0009-0005-8319-9899 ; 0000-0002-1238-4385 ; 0000-0001-9981-8694</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10747267$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,780,784,796,885,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10747267$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://hal.science/hal-04763696$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Smolentsev, Lev</creatorcontrib><creatorcontrib>Krupa, Alexandre</creatorcontrib><creatorcontrib>Chaumette, Francois</creatorcontrib><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><title>IEEE robotics and automation letters</title><addtitle>LRA</addtitle><description>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</description><subject>aerial systems: perception and autonomy</subject><subject>Autonomous aerial vehicles</subject><subject>Cameras</subject><subject>Communication cables</subject><subject>Computer Science</subject><subject>Drones</subject><subject>Extremities</subject><subject>Power cables</subject><subject>Quadrotors</subject><subject>Robotics</subject><subject>Visual servoing</subject><subject>Visualization</subject><issn>2377-3766</issn><issn>2377-3766</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkDtPwzAURi0EElXpzsDglSHFbzsDQyiPIkVCooXVcuJrGhSSKO5D_HtStUKd7r2fzneHg9A1JVNKSXqXv2dTRpiYcpEKJeUZGjGudcK1Uucn-yWaxPhNCKGSaZ7KEbpfrFwH-LOKG1fjBfTbtmq-cBuwwzNX1IAXm9hB48HjB1jvABq83LX4sW8biFfoIrg6wuQ4x-jj-Wk5myf528vrLMuTkhq6TgzznigPhgRKCw0-eAlKBlN6PVypIMJIagrmmdY-sJQq7o2hpedOu0LyMbo9_F252nZ99eP6X9u6ys6z3O4zIrTiKlVbOrDkwJZ9G2MP4b9Aid3bsoMtu7dlj7aGys2hUgHACa6FZkrzP2F2ZCg</recordid><startdate>202412</startdate><enddate>202412</enddate><creator>Smolentsev, Lev</creator><creator>Krupa, Alexandre</creator><creator>Chaumette, Francois</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>1XC</scope><scope>VOOES</scope><orcidid>https://orcid.org/0009-0005-8319-9899</orcidid><orcidid>https://orcid.org/0000-0002-1238-4385</orcidid><orcidid>https://orcid.org/0000-0001-9981-8694</orcidid></search><sort><creationdate>202412</creationdate><title>Shape Visual Servoing of a Cable Suspended Between Two Drones</title><author>Smolentsev, Lev ; Krupa, Alexandre ; Chaumette, Francois</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c181t-82dd06de80f11b7edfd5e65f8cd77ed94048518b2d277df29163d881cd3a7ab53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>aerial systems: perception and autonomy</topic><topic>Autonomous aerial vehicles</topic><topic>Cameras</topic><topic>Communication cables</topic><topic>Computer Science</topic><topic>Drones</topic><topic>Extremities</topic><topic>Power cables</topic><topic>Quadrotors</topic><topic>Robotics</topic><topic>Visual servoing</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Smolentsev, Lev</creatorcontrib><creatorcontrib>Krupa, Alexandre</creatorcontrib><creatorcontrib>Chaumette, Francois</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>IEEE robotics and automation letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Smolentsev, Lev</au><au>Krupa, Alexandre</au><au>Chaumette, Francois</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Shape Visual Servoing of a Cable Suspended Between Two Drones</atitle><jtitle>IEEE robotics and automation letters</jtitle><stitle>LRA</stitle><date>2024-12</date><risdate>2024</risdate><volume>9</volume><issue>12</issue><spage>11473</spage><epage>11480</epage><pages>11473-11480</pages><issn>2377-3766</issn><eissn>2377-3766</eissn><coden>IRALC6</coden><abstract>In this letter, we propose a shape visual servoing approach for manipulating a suspended cable attached between two quadrotor drones. A leader-follower control strategy is presented, where a human operator controls the rigid motion of the cable by teleoperating one drone (the leader), while the second drone (the follower) performs a shape visual servoing task to autonomously apply a desired deformation to the cable. The proposed shape visual servoing approach uses an RGB-D camera embedded on the follower drone and has the advantage to rely on a simple geometrical model of the cable that only requires the knowledge of its length. In the same time, our control strategy maintains the best visibility of the cable in the camera field of view. A robust image processing pipeline allows detecting and tracking in real-time the cable shape from the data provided by the onboard RGB-D camera. Experimental results demonstrate the effectiveness of the proposed visual control approach to shape a flexible cable into a desired shape. In addition, we demonstrate experimentally that such system can be used to perform an aerial transport task by grasping with the cable an object fitted with a hook, then moving and releasing it at another location.</abstract><pub>IEEE</pub><doi>10.1109/LRA.2024.3494655</doi><tpages>8</tpages><orcidid>https://orcid.org/0009-0005-8319-9899</orcidid><orcidid>https://orcid.org/0000-0002-1238-4385</orcidid><orcidid>https://orcid.org/0000-0001-9981-8694</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2377-3766
ispartof IEEE robotics and automation letters, 2024-12, Vol.9 (12), p.11473-11480
issn 2377-3766
2377-3766
language eng
recordid cdi_hal_primary_oai_HAL_hal_04763696v1
source IEEE Electronic Library (IEL)
subjects aerial systems: perception and autonomy
Autonomous aerial vehicles
Cameras
Communication cables
Computer Science
Drones
Extremities
Power cables
Quadrotors
Robotics
Visual servoing
Visualization
title Shape Visual Servoing of a Cable Suspended Between Two Drones
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T13%3A16%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-hal_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Shape%20Visual%20Servoing%20of%20a%20Cable%20Suspended%20Between%20Two%20Drones&rft.jtitle=IEEE%20robotics%20and%20automation%20letters&rft.au=Smolentsev,%20Lev&rft.date=2024-12&rft.volume=9&rft.issue=12&rft.spage=11473&rft.epage=11480&rft.pages=11473-11480&rft.issn=2377-3766&rft.eissn=2377-3766&rft.coden=IRALC6&rft_id=info:doi/10.1109/LRA.2024.3494655&rft_dat=%3Chal_RIE%3Eoai_HAL_hal_04763696v1%3C/hal_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10747267&rfr_iscdi=true