Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection

Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attrac...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Drones (Basel) 2022-12, Vol.6 (12), p.410
Hauptverfasser: da Silva, Yago M. R, Andrade, Fabio A. A, Sousa, Lucas, de Castro, Gabriel G. R, Dias, João T, Berger, Guido, Lima, José, Pinto, Milena F
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 12
container_start_page 410
container_title Drones (Basel)
container_volume 6
creator da Silva, Yago M. R
Andrade, Fabio A. A
Sousa, Lucas
de Castro, Gabriel G. R
Dias, João T
Berger, Guido
Lima, José
Pinto, Milena F
description Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.
doi_str_mv 10.3390/drones6120410
format Article
fullrecord <record><control><sourceid>gale_proqu</sourceid><recordid>TN_cdi_proquest_journals_2756679420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A744489017</galeid><sourcerecordid>A744489017</sourcerecordid><originalsourceid>FETCH-LOGICAL-g178t-92d13e5c43cf6db570fa42400ede86842ce9c3e49d192bc7b3488143f65b7f093</originalsourceid><addsrcrecordid>eNpNkM1LAzEQxRdRsNQevQc8b83H7GZzrMVqoVBBK97KfkzalN1kTbKI_70r9SBzeI-ZH-_BJMkto3MhFL1vvLMYcsYpMHqRTHhGIQXIPy7_-etkFsKJUso5ZLlik8QvXdcPET15N8E4Sx7KgA15KeORrFzbui9jD0Q7TxZDdNZ1bghkZ8uuG6kFelO25PU7ROwCMXa8VIM3vwGmx9ZYJFsbjs4jWdvQYx3HipvkSpdtwNmfTpPd6vFt-Zxutk_r5WKTHpgsYqp4wwRmNYha502VSapL4EApNljkBfAaVS0QVMMUr2pZCSgKBkLnWSU1VWKa3J1ze-8-Bwxxf3KDt2Plnsssz6UCTkdqfqYOZYt7Y7WLvqzHabAz9fhTbcb9QgJAoSiT4geKmG72</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2756679420</pqid></control><display><type>article</type><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><source>MDPI - Multidisciplinary Digital Publishing Institute</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</creator><creatorcontrib>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</creatorcontrib><description>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil &amp; Gas (O&amp;G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil &amp; Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</description><identifier>ISSN: 2504-446X</identifier><identifier>EISSN: 2504-446X</identifier><identifier>DOI: 10.3390/drones6120410</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Algorithms ; Artificial neural networks ; Autonomous navigation ; Autonomous underwater vehicles ; Computer simulation ; Computer vision ; Control systems ; Corrosion ; Deep learning ; Drone aircraft ; Edge detection ; Flight control systems ; Gas industry ; Hough transformation ; Human error ; Image processing ; Inspection ; Inspections ; Machine vision ; Methods ; Morphology ; Neural networks ; Petroleum industry ; Pipes ; Robotics ; Robots ; Robustness (mathematics) ; Technology application ; Tracking problem ; Trajectory planning ; Unmanned aerial vehicles</subject><ispartof>Drones (Basel), 2022-12, Vol.6 (12), p.410</ispartof><rights>COPYRIGHT 2022 MDPI AG</rights><rights>2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,27901,27902</link.rule.ids></links><search><creatorcontrib>da Silva, Yago M. R</creatorcontrib><creatorcontrib>Andrade, Fabio A. A</creatorcontrib><creatorcontrib>Sousa, Lucas</creatorcontrib><creatorcontrib>de Castro, Gabriel G. R</creatorcontrib><creatorcontrib>Dias, João T</creatorcontrib><creatorcontrib>Berger, Guido</creatorcontrib><creatorcontrib>Lima, José</creatorcontrib><creatorcontrib>Pinto, Milena F</creatorcontrib><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><title>Drones (Basel)</title><description>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil &amp; Gas (O&amp;G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil &amp; Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</description><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Autonomous navigation</subject><subject>Autonomous underwater vehicles</subject><subject>Computer simulation</subject><subject>Computer vision</subject><subject>Control systems</subject><subject>Corrosion</subject><subject>Deep learning</subject><subject>Drone aircraft</subject><subject>Edge detection</subject><subject>Flight control systems</subject><subject>Gas industry</subject><subject>Hough transformation</subject><subject>Human error</subject><subject>Image processing</subject><subject>Inspection</subject><subject>Inspections</subject><subject>Machine vision</subject><subject>Methods</subject><subject>Morphology</subject><subject>Neural networks</subject><subject>Petroleum industry</subject><subject>Pipes</subject><subject>Robotics</subject><subject>Robots</subject><subject>Robustness (mathematics)</subject><subject>Technology application</subject><subject>Tracking problem</subject><subject>Trajectory planning</subject><subject>Unmanned aerial vehicles</subject><issn>2504-446X</issn><issn>2504-446X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNpNkM1LAzEQxRdRsNQevQc8b83H7GZzrMVqoVBBK97KfkzalN1kTbKI_70r9SBzeI-ZH-_BJMkto3MhFL1vvLMYcsYpMHqRTHhGIQXIPy7_-etkFsKJUso5ZLlik8QvXdcPET15N8E4Sx7KgA15KeORrFzbui9jD0Q7TxZDdNZ1bghkZ8uuG6kFelO25PU7ROwCMXa8VIM3vwGmx9ZYJFsbjs4jWdvQYx3HipvkSpdtwNmfTpPd6vFt-Zxutk_r5WKTHpgsYqp4wwRmNYha502VSapL4EApNljkBfAaVS0QVMMUr2pZCSgKBkLnWSU1VWKa3J1ze-8-Bwxxf3KDt2Plnsssz6UCTkdqfqYOZYt7Y7WLvqzHabAz9fhTbcb9QgJAoSiT4geKmG72</recordid><startdate>20221201</startdate><enddate>20221201</enddate><creator>da Silva, Yago M. R</creator><creator>Andrade, Fabio A. A</creator><creator>Sousa, Lucas</creator><creator>de Castro, Gabriel G. R</creator><creator>Dias, João T</creator><creator>Berger, Guido</creator><creator>Lima, José</creator><creator>Pinto, Milena F</creator><general>MDPI AG</general><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20221201</creationdate><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><author>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g178t-92d13e5c43cf6db570fa42400ede86842ce9c3e49d192bc7b3488143f65b7f093</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Autonomous navigation</topic><topic>Autonomous underwater vehicles</topic><topic>Computer simulation</topic><topic>Computer vision</topic><topic>Control systems</topic><topic>Corrosion</topic><topic>Deep learning</topic><topic>Drone aircraft</topic><topic>Edge detection</topic><topic>Flight control systems</topic><topic>Gas industry</topic><topic>Hough transformation</topic><topic>Human error</topic><topic>Image processing</topic><topic>Inspection</topic><topic>Inspections</topic><topic>Machine vision</topic><topic>Methods</topic><topic>Morphology</topic><topic>Neural networks</topic><topic>Petroleum industry</topic><topic>Pipes</topic><topic>Robotics</topic><topic>Robots</topic><topic>Robustness (mathematics)</topic><topic>Technology application</topic><topic>Tracking problem</topic><topic>Trajectory planning</topic><topic>Unmanned aerial vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>da Silva, Yago M. R</creatorcontrib><creatorcontrib>Andrade, Fabio A. A</creatorcontrib><creatorcontrib>Sousa, Lucas</creatorcontrib><creatorcontrib>de Castro, Gabriel G. R</creatorcontrib><creatorcontrib>Dias, João T</creatorcontrib><creatorcontrib>Berger, Guido</creatorcontrib><creatorcontrib>Lima, José</creatorcontrib><creatorcontrib>Pinto, Milena F</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Drones (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>da Silva, Yago M. R</au><au>Andrade, Fabio A. A</au><au>Sousa, Lucas</au><au>de Castro, Gabriel G. R</au><au>Dias, João T</au><au>Berger, Guido</au><au>Lima, José</au><au>Pinto, Milena F</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</atitle><jtitle>Drones (Basel)</jtitle><date>2022-12-01</date><risdate>2022</risdate><volume>6</volume><issue>12</issue><spage>410</spage><pages>410-</pages><issn>2504-446X</issn><eissn>2504-446X</eissn><abstract>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil &amp; Gas (O&amp;G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil &amp; Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/drones6120410</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2504-446X
ispartof Drones (Basel), 2022-12, Vol.6 (12), p.410
issn 2504-446X
2504-446X
language eng
recordid cdi_proquest_journals_2756679420
source MDPI - Multidisciplinary Digital Publishing Institute; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Algorithms
Artificial neural networks
Autonomous navigation
Autonomous underwater vehicles
Computer simulation
Computer vision
Control systems
Corrosion
Deep learning
Drone aircraft
Edge detection
Flight control systems
Gas industry
Hough transformation
Human error
Image processing
Inspection
Inspections
Machine vision
Methods
Morphology
Neural networks
Petroleum industry
Pipes
Robotics
Robots
Robustness (mathematics)
Technology application
Tracking problem
Trajectory planning
Unmanned aerial vehicles
title Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T20%3A34%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Computer%20Vision%20Based%20Path%20Following%20for%20Autonomous%20Unammed%20Aerial%20Systems%20in%20Unburied%20Pipeline%20Onshore%20Inspection&rft.jtitle=Drones%20(Basel)&rft.au=da%20Silva,%20Yago%20M.%20R&rft.date=2022-12-01&rft.volume=6&rft.issue=12&rft.spage=410&rft.pages=410-&rft.issn=2504-446X&rft.eissn=2504-446X&rft_id=info:doi/10.3390/drones6120410&rft_dat=%3Cgale_proqu%3EA744489017%3C/gale_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2756679420&rft_id=info:pmid/&rft_galeid=A744489017&rfr_iscdi=true