Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images

Accurate detection of power lines in aerial images is of great significance in ensuring grid security. However, complex power line scenarios and the thin and light structure of power lines both make it difficult to detect power lines accurately. Most of the existing approaches use traditional deep l...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of sensors 2023, Vol.2023 (1)
Hauptverfasser: Zhang, Guanying, Shu, Yunhao, Zhu, Wenming, Ma, Jianxun, Liu, Yun, Xu, Chang
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 1
container_start_page
container_title Journal of sensors
container_volume 2023
creator Zhang, Guanying
Shu, Yunhao
Zhu, Wenming
Ma, Jianxun
Liu, Yun
Xu, Chang
description Accurate detection of power lines in aerial images is of great significance in ensuring grid security. However, complex power line scenarios and the thin and light structure of power lines both make it difficult to detect power lines accurately. Most of the existing approaches use traditional deep learning methods, using networks with a large number of parameters, computation, and memory occupation, thus making them not lightweight enough to perform on mobile devices. Based on this, a lightweight power line detection network based on direction consistency and location attention is proposed. The network is designed with a coordinate-aware feature extraction layer, which performs feature extraction by four-layer stacking to achieve faster inference speed while ensuring the network has fewer parameters. This layer is also able to sense the coordinates of the center pixel of the convolution in the image during the convolution process, thus preserving the location information of the power lines. In order to enhance the power line representation, a two-stage context-guided module is later utilized to simultaneously learn local features, surrounding context, and global context. Then, the features are input into a Gaussian kernel estimation module and features are aggregated in the corresponding directions through Gaussian kernels of eight different directions. The main directions of the power lines in the image and the corresponding Gaussian convolution kernels are obtained by filtering the feature responses. In addition, a kernel-guided decoder module is proposed to take advantage of the estimated power line features in the main direction of Gaussian kernel aggregation. This module can effectively enhance the power line representation and maintain the continuity of power lines. Meanwhile, low-level features are introduced to recover the edge details to realize high performance in distinguishing dense power lines. Both ablation experiments and comparison experiments on the transmission towers and power lines aerial-image and Power Line Aerial Image Dataset show that the proposed power line detection network has a good segmentation performance in complex scenarios. The proposed method performs the best in the comparison experiments, improving over the suboptimal method by 3.51% on average for the max F-measure metric.
doi_str_mv 10.1155/2023/1987988
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2914320162</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2914320162</sourcerecordid><originalsourceid>FETCH-LOGICAL-c361t-5d240eda98bf518f5b4adfc9a44ad799bf897ba4b9ef0719f66dfd8afaa844073</originalsourceid><addsrcrecordid>eNp9kMFOAjEQhhujiYjefIBNPOpKu-1u2yMBRBKiHjR623S3UyjCFtuSDW_vEohHL_NPJt_MJB9CtwQ_EpLngwxndECk4FKIM9QjheApzwpx_tfnX5foKoQVxgXllPbQ59h6qKN1TTJyTbAhQlPv0-nOatDJ3C6WsYVDTd5cC76bNJCMIZ52XiC2zn8nxvlkCN6qdTLbqAWEa3Rh1DrAzSn76ONp8j56Tuev09loOE9rWpCY5jpjGLSSojI5ESavmNKmlop1yaWsjJC8UqySYDAn0hSFNlooo5RgDHPaR3fHu1vvfnYQYrlyO990L8tMEkYzTIqsox6OVO1dCB5MufV2o_y-JLg8qCsP6sqTug6_P-JL22jV2v_pX3Xybw4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2914320162</pqid></control><display><type>article</type><title>Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images</title><source>Wiley Online Library Open Access</source><source>EZB-FREE-00999 freely available EZB journals</source><source>Alma/SFX Local Collection</source><creator>Zhang, Guanying ; Shu, Yunhao ; Zhu, Wenming ; Ma, Jianxun ; Liu, Yun ; Xu, Chang</creator><contributor>Tang, Yunchao ; Yunchao Tang</contributor><creatorcontrib>Zhang, Guanying ; Shu, Yunhao ; Zhu, Wenming ; Ma, Jianxun ; Liu, Yun ; Xu, Chang ; Tang, Yunchao ; Yunchao Tang</creatorcontrib><description>Accurate detection of power lines in aerial images is of great significance in ensuring grid security. However, complex power line scenarios and the thin and light structure of power lines both make it difficult to detect power lines accurately. Most of the existing approaches use traditional deep learning methods, using networks with a large number of parameters, computation, and memory occupation, thus making them not lightweight enough to perform on mobile devices. Based on this, a lightweight power line detection network based on direction consistency and location attention is proposed. The network is designed with a coordinate-aware feature extraction layer, which performs feature extraction by four-layer stacking to achieve faster inference speed while ensuring the network has fewer parameters. This layer is also able to sense the coordinates of the center pixel of the convolution in the image during the convolution process, thus preserving the location information of the power lines. In order to enhance the power line representation, a two-stage context-guided module is later utilized to simultaneously learn local features, surrounding context, and global context. Then, the features are input into a Gaussian kernel estimation module and features are aggregated in the corresponding directions through Gaussian kernels of eight different directions. The main directions of the power lines in the image and the corresponding Gaussian convolution kernels are obtained by filtering the feature responses. In addition, a kernel-guided decoder module is proposed to take advantage of the estimated power line features in the main direction of Gaussian kernel aggregation. This module can effectively enhance the power line representation and maintain the continuity of power lines. Meanwhile, low-level features are introduced to recover the edge details to realize high performance in distinguishing dense power lines. Both ablation experiments and comparison experiments on the transmission towers and power lines aerial-image and Power Line Aerial Image Dataset show that the proposed power line detection network has a good segmentation performance in complex scenarios. The proposed method performs the best in the comparison experiments, improving over the suboptimal method by 3.51% on average for the max F-measure metric.</description><identifier>ISSN: 1687-725X</identifier><identifier>EISSN: 1687-7268</identifier><identifier>DOI: 10.1155/2023/1987988</identifier><language>eng</language><publisher>New York: Hindawi</publisher><subject>Ablation ; Algorithms ; Consistency ; Context ; Convolution ; Datasets ; Deep learning ; Electrocutions ; Feature extraction ; Lightweight ; Methods ; Modules ; Parameters ; Power lines ; Representations ; Semantics ; Sensors ; Transmission towers ; Unmanned aerial vehicles</subject><ispartof>Journal of sensors, 2023, Vol.2023 (1)</ispartof><rights>Copyright © 2023 Guanying Zhang et al.</rights><rights>Copyright © 2023 Guanying Zhang et al. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c361t-5d240eda98bf518f5b4adfc9a44ad799bf897ba4b9ef0719f66dfd8afaa844073</cites><orcidid>0000-0002-5968-9290 ; 0009-0000-4790-7206 ; 0009-0005-7092-8335 ; 0009-0007-0692-5783 ; 0009-0008-2457-7257 ; 0009-0009-1686-1829</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,4010,27900,27901,27902</link.rule.ids></links><search><contributor>Tang, Yunchao</contributor><contributor>Yunchao Tang</contributor><creatorcontrib>Zhang, Guanying</creatorcontrib><creatorcontrib>Shu, Yunhao</creatorcontrib><creatorcontrib>Zhu, Wenming</creatorcontrib><creatorcontrib>Ma, Jianxun</creatorcontrib><creatorcontrib>Liu, Yun</creatorcontrib><creatorcontrib>Xu, Chang</creatorcontrib><title>Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images</title><title>Journal of sensors</title><description>Accurate detection of power lines in aerial images is of great significance in ensuring grid security. However, complex power line scenarios and the thin and light structure of power lines both make it difficult to detect power lines accurately. Most of the existing approaches use traditional deep learning methods, using networks with a large number of parameters, computation, and memory occupation, thus making them not lightweight enough to perform on mobile devices. Based on this, a lightweight power line detection network based on direction consistency and location attention is proposed. The network is designed with a coordinate-aware feature extraction layer, which performs feature extraction by four-layer stacking to achieve faster inference speed while ensuring the network has fewer parameters. This layer is also able to sense the coordinates of the center pixel of the convolution in the image during the convolution process, thus preserving the location information of the power lines. In order to enhance the power line representation, a two-stage context-guided module is later utilized to simultaneously learn local features, surrounding context, and global context. Then, the features are input into a Gaussian kernel estimation module and features are aggregated in the corresponding directions through Gaussian kernels of eight different directions. The main directions of the power lines in the image and the corresponding Gaussian convolution kernels are obtained by filtering the feature responses. In addition, a kernel-guided decoder module is proposed to take advantage of the estimated power line features in the main direction of Gaussian kernel aggregation. This module can effectively enhance the power line representation and maintain the continuity of power lines. Meanwhile, low-level features are introduced to recover the edge details to realize high performance in distinguishing dense power lines. Both ablation experiments and comparison experiments on the transmission towers and power lines aerial-image and Power Line Aerial Image Dataset show that the proposed power line detection network has a good segmentation performance in complex scenarios. The proposed method performs the best in the comparison experiments, improving over the suboptimal method by 3.51% on average for the max F-measure metric.</description><subject>Ablation</subject><subject>Algorithms</subject><subject>Consistency</subject><subject>Context</subject><subject>Convolution</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Electrocutions</subject><subject>Feature extraction</subject><subject>Lightweight</subject><subject>Methods</subject><subject>Modules</subject><subject>Parameters</subject><subject>Power lines</subject><subject>Representations</subject><subject>Semantics</subject><subject>Sensors</subject><subject>Transmission towers</subject><subject>Unmanned aerial vehicles</subject><issn>1687-725X</issn><issn>1687-7268</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RHX</sourceid><sourceid>BENPR</sourceid><recordid>eNp9kMFOAjEQhhujiYjefIBNPOpKu-1u2yMBRBKiHjR623S3UyjCFtuSDW_vEohHL_NPJt_MJB9CtwQ_EpLngwxndECk4FKIM9QjheApzwpx_tfnX5foKoQVxgXllPbQ59h6qKN1TTJyTbAhQlPv0-nOatDJ3C6WsYVDTd5cC76bNJCMIZ52XiC2zn8nxvlkCN6qdTLbqAWEa3Rh1DrAzSn76ONp8j56Tuev09loOE9rWpCY5jpjGLSSojI5ESavmNKmlop1yaWsjJC8UqySYDAn0hSFNlooo5RgDHPaR3fHu1vvfnYQYrlyO990L8tMEkYzTIqsox6OVO1dCB5MufV2o_y-JLg8qCsP6sqTug6_P-JL22jV2v_pX3Xybw4</recordid><startdate>2023</startdate><enddate>2023</enddate><creator>Zhang, Guanying</creator><creator>Shu, Yunhao</creator><creator>Zhu, Wenming</creator><creator>Ma, Jianxun</creator><creator>Liu, Yun</creator><creator>Xu, Chang</creator><general>Hindawi</general><general>Hindawi Limited</general><scope>RHU</scope><scope>RHW</scope><scope>RHX</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SP</scope><scope>7U5</scope><scope>7XB</scope><scope>8AL</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>CWDGH</scope><scope>D1I</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>KB.</scope><scope>L6V</scope><scope>L7M</scope><scope>M0N</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0002-5968-9290</orcidid><orcidid>https://orcid.org/0009-0000-4790-7206</orcidid><orcidid>https://orcid.org/0009-0005-7092-8335</orcidid><orcidid>https://orcid.org/0009-0007-0692-5783</orcidid><orcidid>https://orcid.org/0009-0008-2457-7257</orcidid><orcidid>https://orcid.org/0009-0009-1686-1829</orcidid></search><sort><creationdate>2023</creationdate><title>Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images</title><author>Zhang, Guanying ; Shu, Yunhao ; Zhu, Wenming ; Ma, Jianxun ; Liu, Yun ; Xu, Chang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c361t-5d240eda98bf518f5b4adfc9a44ad799bf897ba4b9ef0719f66dfd8afaa844073</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Ablation</topic><topic>Algorithms</topic><topic>Consistency</topic><topic>Context</topic><topic>Convolution</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Electrocutions</topic><topic>Feature extraction</topic><topic>Lightweight</topic><topic>Methods</topic><topic>Modules</topic><topic>Parameters</topic><topic>Power lines</topic><topic>Representations</topic><topic>Semantics</topic><topic>Sensors</topic><topic>Transmission towers</topic><topic>Unmanned aerial vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Guanying</creatorcontrib><creatorcontrib>Shu, Yunhao</creatorcontrib><creatorcontrib>Zhu, Wenming</creatorcontrib><creatorcontrib>Ma, Jianxun</creatorcontrib><creatorcontrib>Liu, Yun</creatorcontrib><creatorcontrib>Xu, Chang</creatorcontrib><collection>Hindawi Publishing Complete</collection><collection>Hindawi Publishing Subscription Journals</collection><collection>Hindawi Publishing Open Access</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Computing Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>Middle East &amp; Africa Database</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Materials Science Database</collection><collection>ProQuest Engineering Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computing Database</collection><collection>Engineering Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><jtitle>Journal of sensors</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Guanying</au><au>Shu, Yunhao</au><au>Zhu, Wenming</au><au>Ma, Jianxun</au><au>Liu, Yun</au><au>Xu, Chang</au><au>Tang, Yunchao</au><au>Yunchao Tang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images</atitle><jtitle>Journal of sensors</jtitle><date>2023</date><risdate>2023</risdate><volume>2023</volume><issue>1</issue><issn>1687-725X</issn><eissn>1687-7268</eissn><abstract>Accurate detection of power lines in aerial images is of great significance in ensuring grid security. However, complex power line scenarios and the thin and light structure of power lines both make it difficult to detect power lines accurately. Most of the existing approaches use traditional deep learning methods, using networks with a large number of parameters, computation, and memory occupation, thus making them not lightweight enough to perform on mobile devices. Based on this, a lightweight power line detection network based on direction consistency and location attention is proposed. The network is designed with a coordinate-aware feature extraction layer, which performs feature extraction by four-layer stacking to achieve faster inference speed while ensuring the network has fewer parameters. This layer is also able to sense the coordinates of the center pixel of the convolution in the image during the convolution process, thus preserving the location information of the power lines. In order to enhance the power line representation, a two-stage context-guided module is later utilized to simultaneously learn local features, surrounding context, and global context. Then, the features are input into a Gaussian kernel estimation module and features are aggregated in the corresponding directions through Gaussian kernels of eight different directions. The main directions of the power lines in the image and the corresponding Gaussian convolution kernels are obtained by filtering the feature responses. In addition, a kernel-guided decoder module is proposed to take advantage of the estimated power line features in the main direction of Gaussian kernel aggregation. This module can effectively enhance the power line representation and maintain the continuity of power lines. Meanwhile, low-level features are introduced to recover the edge details to realize high performance in distinguishing dense power lines. Both ablation experiments and comparison experiments on the transmission towers and power lines aerial-image and Power Line Aerial Image Dataset show that the proposed power line detection network has a good segmentation performance in complex scenarios. The proposed method performs the best in the comparison experiments, improving over the suboptimal method by 3.51% on average for the max F-measure metric.</abstract><cop>New York</cop><pub>Hindawi</pub><doi>10.1155/2023/1987988</doi><orcidid>https://orcid.org/0000-0002-5968-9290</orcidid><orcidid>https://orcid.org/0009-0000-4790-7206</orcidid><orcidid>https://orcid.org/0009-0005-7092-8335</orcidid><orcidid>https://orcid.org/0009-0007-0692-5783</orcidid><orcidid>https://orcid.org/0009-0008-2457-7257</orcidid><orcidid>https://orcid.org/0009-0009-1686-1829</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1687-725X
ispartof Journal of sensors, 2023, Vol.2023 (1)
issn 1687-725X
1687-7268
language eng
recordid cdi_proquest_journals_2914320162
source Wiley Online Library Open Access; EZB-FREE-00999 freely available EZB journals; Alma/SFX Local Collection
subjects Ablation
Algorithms
Consistency
Context
Convolution
Datasets
Deep learning
Electrocutions
Feature extraction
Lightweight
Methods
Modules
Parameters
Power lines
Representations
Semantics
Sensors
Transmission towers
Unmanned aerial vehicles
title Direction Consistency-Guided Lightweight Power Line Detection Network for Aerial Images
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T17%3A55%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Direction%20Consistency-Guided%20Lightweight%20Power%20Line%20Detection%20Network%20for%20Aerial%20Images&rft.jtitle=Journal%20of%20sensors&rft.au=Zhang,%20Guanying&rft.date=2023&rft.volume=2023&rft.issue=1&rft.issn=1687-725X&rft.eissn=1687-7268&rft_id=info:doi/10.1155/2023/1987988&rft_dat=%3Cproquest_cross%3E2914320162%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2914320162&rft_id=info:pmid/&rfr_iscdi=true