Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images

In high-resolution remote sensing images, road scale diversity and occlusions caused by shadows, buildings, and vegetation often pose challenges for road extraction. Currently, end-to-end models constructed using deep convolutional neural networks are widely used in road extraction and have signific...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE journal of selected topics in applied earth observations and remote sensing 2023-01, Vol.16, p.1-13
Hauptverfasser: Lin, Yuzhun, Jin, Fei, Wang, Dandi, Wang, Shuxiang, Liu, Xiao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 13
container_issue
container_start_page 1
container_title IEEE journal of selected topics in applied earth observations and remote sensing
container_volume 16
creator Lin, Yuzhun
Jin, Fei
Wang, Dandi
Wang, Shuxiang
Liu, Xiao
description In high-resolution remote sensing images, road scale diversity and occlusions caused by shadows, buildings, and vegetation often pose challenges for road extraction. Currently, end-to-end models constructed using deep convolutional neural networks are widely used in road extraction and have significantly improved the accuracy of this task. However, the connectivity and completeness of their results require improvement. This paper proposes a dual task-driven deep convolutional neural network constructed by combining road shape patterns and scale differences. The mainline task is road-surface segmentation, the encoder of which employs residual convolution for feature extraction. The decoder comprises a multi-scale and multi-direction strip convolution module, the output of which is the final extraction result. The splitting task is road centerline extraction, the input features of which come from the coding layer of the road-surface segmentation branches. The intermediate features are incorporated into the decoder of the road-surface segmentation branches, to fully exploit the road centerline and thus improve the road-surface segmentation result connectivity. Implementation of the proposed method on the CHN6-CUG and DeepGlobe datasets reveals superior performance to comparative methods as regards quantitative evaluation metrics; evident advantages for road coverings, road intersections, and low-scale roads; greater model portability; and better small-sample learning capability.
doi_str_mv 10.1109/JSTARS.2023.3289217
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_proquest_journals_2837133412</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10162179</ieee_id><doaj_id>oai_doaj_org_article_6cf31f6fd224466d85fba1ae0d5b1118</doaj_id><sourcerecordid>2837133412</sourcerecordid><originalsourceid>FETCH-LOGICAL-c409t-504d6b8e5050faa636fc292db54e7314c4c1d671552dd5b8256f3c57779747863</originalsourceid><addsrcrecordid>eNpNkVtLAzEQhYMoWKu_QB8WfN6ayXXzKFq1IiptfQ5pLnVr29Rki_rvXbsiPg2cOefMwIfQKeABAFYX95Pp5XgyIJjQASWVIiD3UI8AhxI45fuoB4qqEhhmh-go5wXGgkhFe-j5emuW5dTkt-LRNx8xvRUhpmIcjSuGn00ytqnjuggproq7ev5ajn2Oy-1OHPtVbHwx8etcr-fFaGXmPh-jg2CW2Z_8zj56uRlOr-7Kh6fb0dXlQ2kZVk3JMXNiVnmOOQ7GCCqCJYq4GWdeUmCWWXBCAufEOT6rCBeBWi6lVJLJStA-GnW9LpqF3qR6ZdKXjqbWOyGmuTapqe3Sa2EDhSCCI4QxIVzFw8yA8bgtBoCq7TrvujYpvm99bvQibtO6fV-TikqglAFpXbRz2RRzTj78XQWsfzDoDoP-waB_MbSpsy5Ve-__JUC0W0W_Ab10gng</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2837133412</pqid></control><display><type>article</type><title>Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images</title><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Lin, Yuzhun ; Jin, Fei ; Wang, Dandi ; Wang, Shuxiang ; Liu, Xiao</creator><creatorcontrib>Lin, Yuzhun ; Jin, Fei ; Wang, Dandi ; Wang, Shuxiang ; Liu, Xiao</creatorcontrib><description>In high-resolution remote sensing images, road scale diversity and occlusions caused by shadows, buildings, and vegetation often pose challenges for road extraction. Currently, end-to-end models constructed using deep convolutional neural networks are widely used in road extraction and have significantly improved the accuracy of this task. However, the connectivity and completeness of their results require improvement. This paper proposes a dual task-driven deep convolutional neural network constructed by combining road shape patterns and scale differences. The mainline task is road-surface segmentation, the encoder of which employs residual convolution for feature extraction. The decoder comprises a multi-scale and multi-direction strip convolution module, the output of which is the final extraction result. The splitting task is road centerline extraction, the input features of which come from the coding layer of the road-surface segmentation branches. The intermediate features are incorporated into the decoder of the road-surface segmentation branches, to fully exploit the road centerline and thus improve the road-surface segmentation result connectivity. Implementation of the proposed method on the CHN6-CUG and DeepGlobe datasets reveals superior performance to comparative methods as regards quantitative evaluation metrics; evident advantages for road coverings, road intersections, and low-scale roads; greater model portability; and better small-sample learning capability.</description><identifier>ISSN: 1939-1404</identifier><identifier>EISSN: 2151-1535</identifier><identifier>DOI: 10.1109/JSTARS.2023.3289217</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Artificial neural networks ; Coders ; Convolution ; convolutional neural network ; Convolutional neural network (CNN) ; deep learning ; Feature extraction ; High resolution ; Image resolution ; Image segmentation ; Kernel ; Neural networks ; Remote sensing ; remote sensing image ; road centerline ; road extraction ; Roads ; Roads &amp; highways ; Shape ; Task analysis</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2023-01, Vol.16, p.1-13</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c409t-504d6b8e5050faa636fc292db54e7314c4c1d671552dd5b8256f3c57779747863</citedby><cites>FETCH-LOGICAL-c409t-504d6b8e5050faa636fc292db54e7314c4c1d671552dd5b8256f3c57779747863</cites><orcidid>0000-0001-9860-0650 ; 0000-0002-9560-1620 ; 0009-0000-4102-922X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,781,785,865,2103,27929,27930</link.rule.ids></links><search><creatorcontrib>Lin, Yuzhun</creatorcontrib><creatorcontrib>Jin, Fei</creatorcontrib><creatorcontrib>Wang, Dandi</creatorcontrib><creatorcontrib>Wang, Shuxiang</creatorcontrib><creatorcontrib>Liu, Xiao</creatorcontrib><title>Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>In high-resolution remote sensing images, road scale diversity and occlusions caused by shadows, buildings, and vegetation often pose challenges for road extraction. Currently, end-to-end models constructed using deep convolutional neural networks are widely used in road extraction and have significantly improved the accuracy of this task. However, the connectivity and completeness of their results require improvement. This paper proposes a dual task-driven deep convolutional neural network constructed by combining road shape patterns and scale differences. The mainline task is road-surface segmentation, the encoder of which employs residual convolution for feature extraction. The decoder comprises a multi-scale and multi-direction strip convolution module, the output of which is the final extraction result. The splitting task is road centerline extraction, the input features of which come from the coding layer of the road-surface segmentation branches. The intermediate features are incorporated into the decoder of the road-surface segmentation branches, to fully exploit the road centerline and thus improve the road-surface segmentation result connectivity. Implementation of the proposed method on the CHN6-CUG and DeepGlobe datasets reveals superior performance to comparative methods as regards quantitative evaluation metrics; evident advantages for road coverings, road intersections, and low-scale roads; greater model portability; and better small-sample learning capability.</description><subject>Artificial neural networks</subject><subject>Coders</subject><subject>Convolution</subject><subject>convolutional neural network</subject><subject>Convolutional neural network (CNN)</subject><subject>deep learning</subject><subject>Feature extraction</subject><subject>High resolution</subject><subject>Image resolution</subject><subject>Image segmentation</subject><subject>Kernel</subject><subject>Neural networks</subject><subject>Remote sensing</subject><subject>remote sensing image</subject><subject>road centerline</subject><subject>road extraction</subject><subject>Roads</subject><subject>Roads &amp; highways</subject><subject>Shape</subject><subject>Task analysis</subject><issn>1939-1404</issn><issn>2151-1535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkVtLAzEQhYMoWKu_QB8WfN6ayXXzKFq1IiptfQ5pLnVr29Rki_rvXbsiPg2cOefMwIfQKeABAFYX95Pp5XgyIJjQASWVIiD3UI8AhxI45fuoB4qqEhhmh-go5wXGgkhFe-j5emuW5dTkt-LRNx8xvRUhpmIcjSuGn00ytqnjuggproq7ev5ajn2Oy-1OHPtVbHwx8etcr-fFaGXmPh-jg2CW2Z_8zj56uRlOr-7Kh6fb0dXlQ2kZVk3JMXNiVnmOOQ7GCCqCJYq4GWdeUmCWWXBCAufEOT6rCBeBWi6lVJLJStA-GnW9LpqF3qR6ZdKXjqbWOyGmuTapqe3Sa2EDhSCCI4QxIVzFw8yA8bgtBoCq7TrvujYpvm99bvQibtO6fV-TikqglAFpXbRz2RRzTj78XQWsfzDoDoP-waB_MbSpsy5Ve-__JUC0W0W_Ab10gng</recordid><startdate>20230101</startdate><enddate>20230101</enddate><creator>Lin, Yuzhun</creator><creator>Jin, Fei</creator><creator>Wang, Dandi</creator><creator>Wang, Shuxiang</creator><creator>Liu, Xiao</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>FR3</scope><scope>H8D</scope><scope>H96</scope><scope>KR7</scope><scope>L.G</scope><scope>L7M</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-9860-0650</orcidid><orcidid>https://orcid.org/0000-0002-9560-1620</orcidid><orcidid>https://orcid.org/0009-0000-4102-922X</orcidid></search><sort><creationdate>20230101</creationdate><title>Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images</title><author>Lin, Yuzhun ; Jin, Fei ; Wang, Dandi ; Wang, Shuxiang ; Liu, Xiao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c409t-504d6b8e5050faa636fc292db54e7314c4c1d671552dd5b8256f3c57779747863</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Artificial neural networks</topic><topic>Coders</topic><topic>Convolution</topic><topic>convolutional neural network</topic><topic>Convolutional neural network (CNN)</topic><topic>deep learning</topic><topic>Feature extraction</topic><topic>High resolution</topic><topic>Image resolution</topic><topic>Image segmentation</topic><topic>Kernel</topic><topic>Neural networks</topic><topic>Remote sensing</topic><topic>remote sensing image</topic><topic>road centerline</topic><topic>road extraction</topic><topic>Roads</topic><topic>Roads &amp; highways</topic><topic>Shape</topic><topic>Task analysis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lin, Yuzhun</creatorcontrib><creatorcontrib>Jin, Fei</creatorcontrib><creatorcontrib>Wang, Dandi</creatorcontrib><creatorcontrib>Wang, Shuxiang</creatorcontrib><creatorcontrib>Liu, Xiao</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lin, Yuzhun</au><au>Jin, Fei</au><au>Wang, Dandi</au><au>Wang, Shuxiang</au><au>Liu, Xiao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2023-01-01</date><risdate>2023</risdate><volume>16</volume><spage>1</spage><epage>13</epage><pages>1-13</pages><issn>1939-1404</issn><eissn>2151-1535</eissn><coden>IJSTHZ</coden><abstract>In high-resolution remote sensing images, road scale diversity and occlusions caused by shadows, buildings, and vegetation often pose challenges for road extraction. Currently, end-to-end models constructed using deep convolutional neural networks are widely used in road extraction and have significantly improved the accuracy of this task. However, the connectivity and completeness of their results require improvement. This paper proposes a dual task-driven deep convolutional neural network constructed by combining road shape patterns and scale differences. The mainline task is road-surface segmentation, the encoder of which employs residual convolution for feature extraction. The decoder comprises a multi-scale and multi-direction strip convolution module, the output of which is the final extraction result. The splitting task is road centerline extraction, the input features of which come from the coding layer of the road-surface segmentation branches. The intermediate features are incorporated into the decoder of the road-surface segmentation branches, to fully exploit the road centerline and thus improve the road-surface segmentation result connectivity. Implementation of the proposed method on the CHN6-CUG and DeepGlobe datasets reveals superior performance to comparative methods as regards quantitative evaluation metrics; evident advantages for road coverings, road intersections, and low-scale roads; greater model portability; and better small-sample learning capability.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/JSTARS.2023.3289217</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-9860-0650</orcidid><orcidid>https://orcid.org/0000-0002-9560-1620</orcidid><orcidid>https://orcid.org/0009-0000-4102-922X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1939-1404
ispartof IEEE journal of selected topics in applied earth observations and remote sensing, 2023-01, Vol.16, p.1-13
issn 1939-1404
2151-1535
language eng
recordid cdi_proquest_journals_2837133412
source DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Artificial neural networks
Coders
Convolution
convolutional neural network
Convolutional neural network (CNN)
deep learning
Feature extraction
High resolution
Image resolution
Image segmentation
Kernel
Neural networks
Remote sensing
remote sensing image
road centerline
road extraction
Roads
Roads & highways
Shape
Task analysis
title Dual-Task Network for Road Extraction from High-Resolution Remote Sensing Images
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-16T12%3A18%3A20IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dual-Task%20Network%20for%20Road%20Extraction%20from%20High-Resolution%20Remote%20Sensing%20Images&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Lin,%20Yuzhun&rft.date=2023-01-01&rft.volume=16&rft.spage=1&rft.epage=13&rft.pages=1-13&rft.issn=1939-1404&rft.eissn=2151-1535&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2023.3289217&rft_dat=%3Cproquest_ieee_%3E2837133412%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2837133412&rft_id=info:pmid/&rft_ieee_id=10162179&rft_doaj_id=oai_doaj_org_article_6cf31f6fd224466d85fba1ae0d5b1118&rfr_iscdi=true