Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection
Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attrac...
Gespeichert in:
Veröffentlicht in: | Drones (Basel) 2022-12, Vol.6 (12), p.410 |
---|---|
Hauptverfasser: | , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | 12 |
container_start_page | 410 |
container_title | Drones (Basel) |
container_volume | 6 |
creator | da Silva, Yago M. R Andrade, Fabio A. A Sousa, Lucas de Castro, Gabriel G. R Dias, João T Berger, Guido Lima, José Pinto, Milena F |
description | Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube. |
doi_str_mv | 10.3390/drones6120410 |
format | Article |
fullrecord | <record><control><sourceid>gale_proqu</sourceid><recordid>TN_cdi_proquest_journals_2756679420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A744489017</galeid><sourcerecordid>A744489017</sourcerecordid><originalsourceid>FETCH-LOGICAL-g178t-92d13e5c43cf6db570fa42400ede86842ce9c3e49d192bc7b3488143f65b7f093</originalsourceid><addsrcrecordid>eNpNkM1LAzEQxRdRsNQevQc8b83H7GZzrMVqoVBBK97KfkzalN1kTbKI_70r9SBzeI-ZH-_BJMkto3MhFL1vvLMYcsYpMHqRTHhGIQXIPy7_-etkFsKJUso5ZLlik8QvXdcPET15N8E4Sx7KgA15KeORrFzbui9jD0Q7TxZDdNZ1bghkZ8uuG6kFelO25PU7ROwCMXa8VIM3vwGmx9ZYJFsbjs4jWdvQYx3HipvkSpdtwNmfTpPd6vFt-Zxutk_r5WKTHpgsYqp4wwRmNYha502VSapL4EApNljkBfAaVS0QVMMUr2pZCSgKBkLnWSU1VWKa3J1ze-8-Bwxxf3KDt2Plnsssz6UCTkdqfqYOZYt7Y7WLvqzHabAz9fhTbcb9QgJAoSiT4geKmG72</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2756679420</pqid></control><display><type>article</type><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><source>MDPI - Multidisciplinary Digital Publishing Institute</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</creator><creatorcontrib>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</creatorcontrib><description>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</description><identifier>ISSN: 2504-446X</identifier><identifier>EISSN: 2504-446X</identifier><identifier>DOI: 10.3390/drones6120410</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Algorithms ; Artificial neural networks ; Autonomous navigation ; Autonomous underwater vehicles ; Computer simulation ; Computer vision ; Control systems ; Corrosion ; Deep learning ; Drone aircraft ; Edge detection ; Flight control systems ; Gas industry ; Hough transformation ; Human error ; Image processing ; Inspection ; Inspections ; Machine vision ; Methods ; Morphology ; Neural networks ; Petroleum industry ; Pipes ; Robotics ; Robots ; Robustness (mathematics) ; Technology application ; Tracking problem ; Trajectory planning ; Unmanned aerial vehicles</subject><ispartof>Drones (Basel), 2022-12, Vol.6 (12), p.410</ispartof><rights>COPYRIGHT 2022 MDPI AG</rights><rights>2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,27901,27902</link.rule.ids></links><search><creatorcontrib>da Silva, Yago M. R</creatorcontrib><creatorcontrib>Andrade, Fabio A. A</creatorcontrib><creatorcontrib>Sousa, Lucas</creatorcontrib><creatorcontrib>de Castro, Gabriel G. R</creatorcontrib><creatorcontrib>Dias, João T</creatorcontrib><creatorcontrib>Berger, Guido</creatorcontrib><creatorcontrib>Lima, José</creatorcontrib><creatorcontrib>Pinto, Milena F</creatorcontrib><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><title>Drones (Basel)</title><description>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</description><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Autonomous navigation</subject><subject>Autonomous underwater vehicles</subject><subject>Computer simulation</subject><subject>Computer vision</subject><subject>Control systems</subject><subject>Corrosion</subject><subject>Deep learning</subject><subject>Drone aircraft</subject><subject>Edge detection</subject><subject>Flight control systems</subject><subject>Gas industry</subject><subject>Hough transformation</subject><subject>Human error</subject><subject>Image processing</subject><subject>Inspection</subject><subject>Inspections</subject><subject>Machine vision</subject><subject>Methods</subject><subject>Morphology</subject><subject>Neural networks</subject><subject>Petroleum industry</subject><subject>Pipes</subject><subject>Robotics</subject><subject>Robots</subject><subject>Robustness (mathematics)</subject><subject>Technology application</subject><subject>Tracking problem</subject><subject>Trajectory planning</subject><subject>Unmanned aerial vehicles</subject><issn>2504-446X</issn><issn>2504-446X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNpNkM1LAzEQxRdRsNQevQc8b83H7GZzrMVqoVBBK97KfkzalN1kTbKI_70r9SBzeI-ZH-_BJMkto3MhFL1vvLMYcsYpMHqRTHhGIQXIPy7_-etkFsKJUso5ZLlik8QvXdcPET15N8E4Sx7KgA15KeORrFzbui9jD0Q7TxZDdNZ1bghkZ8uuG6kFelO25PU7ROwCMXa8VIM3vwGmx9ZYJFsbjs4jWdvQYx3HipvkSpdtwNmfTpPd6vFt-Zxutk_r5WKTHpgsYqp4wwRmNYha502VSapL4EApNljkBfAaVS0QVMMUr2pZCSgKBkLnWSU1VWKa3J1ze-8-Bwxxf3KDt2Plnsssz6UCTkdqfqYOZYt7Y7WLvqzHabAz9fhTbcb9QgJAoSiT4geKmG72</recordid><startdate>20221201</startdate><enddate>20221201</enddate><creator>da Silva, Yago M. R</creator><creator>Andrade, Fabio A. A</creator><creator>Sousa, Lucas</creator><creator>de Castro, Gabriel G. R</creator><creator>Dias, João T</creator><creator>Berger, Guido</creator><creator>Lima, José</creator><creator>Pinto, Milena F</creator><general>MDPI AG</general><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20221201</creationdate><title>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</title><author>da Silva, Yago M. R ; Andrade, Fabio A. A ; Sousa, Lucas ; de Castro, Gabriel G. R ; Dias, João T ; Berger, Guido ; Lima, José ; Pinto, Milena F</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g178t-92d13e5c43cf6db570fa42400ede86842ce9c3e49d192bc7b3488143f65b7f093</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Autonomous navigation</topic><topic>Autonomous underwater vehicles</topic><topic>Computer simulation</topic><topic>Computer vision</topic><topic>Control systems</topic><topic>Corrosion</topic><topic>Deep learning</topic><topic>Drone aircraft</topic><topic>Edge detection</topic><topic>Flight control systems</topic><topic>Gas industry</topic><topic>Hough transformation</topic><topic>Human error</topic><topic>Image processing</topic><topic>Inspection</topic><topic>Inspections</topic><topic>Machine vision</topic><topic>Methods</topic><topic>Morphology</topic><topic>Neural networks</topic><topic>Petroleum industry</topic><topic>Pipes</topic><topic>Robotics</topic><topic>Robots</topic><topic>Robustness (mathematics)</topic><topic>Technology application</topic><topic>Tracking problem</topic><topic>Trajectory planning</topic><topic>Unmanned aerial vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>da Silva, Yago M. R</creatorcontrib><creatorcontrib>Andrade, Fabio A. A</creatorcontrib><creatorcontrib>Sousa, Lucas</creatorcontrib><creatorcontrib>de Castro, Gabriel G. R</creatorcontrib><creatorcontrib>Dias, João T</creatorcontrib><creatorcontrib>Berger, Guido</creatorcontrib><creatorcontrib>Lima, José</creatorcontrib><creatorcontrib>Pinto, Milena F</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Drones (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>da Silva, Yago M. R</au><au>Andrade, Fabio A. A</au><au>Sousa, Lucas</au><au>de Castro, Gabriel G. R</au><au>Dias, João T</au><au>Berger, Guido</au><au>Lima, José</au><au>Pinto, Milena F</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection</atitle><jtitle>Drones (Basel)</jtitle><date>2022-12-01</date><risdate>2022</risdate><volume>6</volume><issue>12</issue><spage>410</spage><pages>410-</pages><issn>2504-446X</issn><eissn>2504-446X</eissn><abstract>Unmanned Aerial Systems (UAS) are becoming more attractive in diverse applications due to their efficiency in performing tasks with a reduced time execution, covering a larger area, and lowering human risks at harmful tasks. In the context of Oil & Gas (O&G), the scenario is even more attractive for the application of UAS for inspection activities due to the large extension of these facilities and the operational risks involved in the processes. Many authors proposed solutions to detect gas leaks regarding the onshore unburied pipeline structures. However, only a few addressed the navigation and tracking problem for the autonomous navigation of UAS over these structures. Most proposed solutions rely on traditional computer vision strategies for tracking. As a drawback, depending on lighting conditions, the obtained path line may be inaccurate, making a strategy to force the UAS to continue on the path necessary. Therefore, this research describes the potential of an autonomous UAS based on image processing technique and Convolutional Neural Network (CNN) strategy to navigate appropriately in complex unburied pipeline networks contributing to the monitoring procedure of the Oil & Gas Industry structures. A CNN is used to detect the pipe, while image processing techniques such as Canny edge detection and Hough Transform are used to detect the pipe line reference, which is used by a line following algorithm to guide the UAS along the pipe. The framework is assessed by a PX4 flight controller Software-in-The-Loop (SITL) simulations performed with the Robot Operating System (ROS) along with the Gazebo platform to simulate the proposed operational environment and verify the approach's functionality as a proof of concept. Real tests were also conducted. The results showed that the solution is robust and feasible to deploy in this proposed task, achieving 72% of mean average precision on detecting different types of pipes and 0.0111 m of mean squared error on the path following with a drone 2 m away from a tube.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/drones6120410</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2504-446X |
ispartof | Drones (Basel), 2022-12, Vol.6 (12), p.410 |
issn | 2504-446X 2504-446X |
language | eng |
recordid | cdi_proquest_journals_2756679420 |
source | MDPI - Multidisciplinary Digital Publishing Institute; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals |
subjects | Algorithms Artificial neural networks Autonomous navigation Autonomous underwater vehicles Computer simulation Computer vision Control systems Corrosion Deep learning Drone aircraft Edge detection Flight control systems Gas industry Hough transformation Human error Image processing Inspection Inspections Machine vision Methods Morphology Neural networks Petroleum industry Pipes Robotics Robots Robustness (mathematics) Technology application Tracking problem Trajectory planning Unmanned aerial vehicles |
title | Computer Vision Based Path Following for Autonomous Unammed Aerial Systems in Unburied Pipeline Onshore Inspection |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T20%3A34%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Computer%20Vision%20Based%20Path%20Following%20for%20Autonomous%20Unammed%20Aerial%20Systems%20in%20Unburied%20Pipeline%20Onshore%20Inspection&rft.jtitle=Drones%20(Basel)&rft.au=da%20Silva,%20Yago%20M.%20R&rft.date=2022-12-01&rft.volume=6&rft.issue=12&rft.spage=410&rft.pages=410-&rft.issn=2504-446X&rft.eissn=2504-446X&rft_id=info:doi/10.3390/drones6120410&rft_dat=%3Cgale_proqu%3EA744489017%3C/gale_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2756679420&rft_id=info:pmid/&rft_galeid=A744489017&rfr_iscdi=true |