MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection
The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal ch...
Gespeichert in:
Veröffentlicht in: | IEEE journal of selected topics in applied earth observations and remote sensing 2023-03, p.1-12 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 12 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE journal of selected topics in applied earth observations and remote sensing |
container_volume | |
creator | Li, Hao Liu, Xiaoyong Li, Huihui Dong, Ziyang Xiao, Xiangling |
description | The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset. |
doi_str_mv | 10.1109/JSTARS.2023.3260006 |
format | Article |
fullrecord | <record><control><sourceid>ieee</sourceid><recordid>TN_cdi_ieee_primary_10078073</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10078073</ieee_id><sourcerecordid>10078073</sourcerecordid><originalsourceid>FETCH-ieee_primary_100780733</originalsourceid><addsrcrecordid>eNqFjLFuwjAYhD1QqdD2Ccrwv0DC7xgRwoYgEapEB8KOrOgChsRBjhHi7fHAznS6--5OiF_JsZScTf7K_XJXxgknKlbJjJlnAzGUmcoiOeXppxj1_TmESZqpodDbdZH_wy9oSdtb401UVroBrU1dw8FWoALa3xwotycdfAvrKSzunbtQ3Tnaoe08qITtjT3SKrSO4QAelTed_RYftW56_Lz0S4yLfL_aRAbA4epMq93jIJnTOadKvcFPJPJDxw</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</creator><creatorcontrib>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</creatorcontrib><description>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</description><identifier>ISSN: 1939-1404</identifier><identifier>DOI: 10.1109/JSTARS.2023.3260006</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>IEEE</publisher><subject>Attention mechanism ; change detection (CD) ; Computer vision ; convolutional neural networks (CNNs) ; Decoding ; feature enhancement ; Feature extraction ; Measurement ; pseudo changes ; Remote sensing ; Task analysis ; Transformers</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2023-03, p.1-12</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0003-0463-8178 ; 0000-0002-0795-841X ; 0000-0001-6226-5459</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,864,27924,27925</link.rule.ids></links><search><creatorcontrib>Li, Hao</creatorcontrib><creatorcontrib>Liu, Xiaoyong</creatorcontrib><creatorcontrib>Li, Huihui</creatorcontrib><creatorcontrib>Dong, Ziyang</creatorcontrib><creatorcontrib>Xiao, Xiangling</creatorcontrib><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</description><subject>Attention mechanism</subject><subject>change detection (CD)</subject><subject>Computer vision</subject><subject>convolutional neural networks (CNNs)</subject><subject>Decoding</subject><subject>feature enhancement</subject><subject>Feature extraction</subject><subject>Measurement</subject><subject>pseudo changes</subject><subject>Remote sensing</subject><subject>Task analysis</subject><subject>Transformers</subject><issn>1939-1404</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><recordid>eNqFjLFuwjAYhD1QqdD2Ccrwv0DC7xgRwoYgEapEB8KOrOgChsRBjhHi7fHAznS6--5OiF_JsZScTf7K_XJXxgknKlbJjJlnAzGUmcoiOeXppxj1_TmESZqpodDbdZH_wy9oSdtb401UVroBrU1dw8FWoALa3xwotycdfAvrKSzunbtQ3Tnaoe08qITtjT3SKrSO4QAelTed_RYftW56_Lz0S4yLfL_aRAbA4epMq93jIJnTOadKvcFPJPJDxw</recordid><startdate>20230321</startdate><enddate>20230321</enddate><creator>Li, Hao</creator><creator>Liu, Xiaoyong</creator><creator>Li, Huihui</creator><creator>Dong, Ziyang</creator><creator>Xiao, Xiangling</creator><general>IEEE</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><orcidid>https://orcid.org/0000-0003-0463-8178</orcidid><orcidid>https://orcid.org/0000-0002-0795-841X</orcidid><orcidid>https://orcid.org/0000-0001-6226-5459</orcidid></search><sort><creationdate>20230321</creationdate><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><author>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-ieee_primary_100780733</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Attention mechanism</topic><topic>change detection (CD)</topic><topic>Computer vision</topic><topic>convolutional neural networks (CNNs)</topic><topic>Decoding</topic><topic>feature enhancement</topic><topic>Feature extraction</topic><topic>Measurement</topic><topic>pseudo changes</topic><topic>Remote sensing</topic><topic>Task analysis</topic><topic>Transformers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Hao</creatorcontrib><creatorcontrib>Liu, Xiaoyong</creatorcontrib><creatorcontrib>Li, Huihui</creatorcontrib><creatorcontrib>Dong, Ziyang</creatorcontrib><creatorcontrib>Xiao, Xiangling</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Hao</au><au>Liu, Xiaoyong</au><au>Li, Huihui</au><au>Dong, Ziyang</au><au>Xiao, Xiangling</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2023-03-21</date><risdate>2023</risdate><spage>1</spage><epage>12</epage><pages>1-12</pages><issn>1939-1404</issn><coden>IJSTHZ</coden><abstract>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</abstract><pub>IEEE</pub><doi>10.1109/JSTARS.2023.3260006</doi><orcidid>https://orcid.org/0000-0003-0463-8178</orcidid><orcidid>https://orcid.org/0000-0002-0795-841X</orcidid><orcidid>https://orcid.org/0000-0001-6226-5459</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1939-1404 |
ispartof | IEEE journal of selected topics in applied earth observations and remote sensing, 2023-03, p.1-12 |
issn | 1939-1404 |
language | eng |
recordid | cdi_ieee_primary_10078073 |
source | DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals |
subjects | Attention mechanism change detection (CD) Computer vision convolutional neural networks (CNNs) Decoding feature enhancement Feature extraction Measurement pseudo changes Remote sensing Task analysis Transformers |
title | MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T05%3A31%3A18IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MDFENet:%20A%20Multi-Scale%20Difference%20Feature%20Enhancement%20Network%20for%20Remote%20Sensing%20Change%20Detection&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Li,%20Hao&rft.date=2023-03-21&rft.spage=1&rft.epage=12&rft.pages=1-12&rft.issn=1939-1404&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2023.3260006&rft_dat=%3Cieee%3E10078073%3C/ieee%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10078073&rfr_iscdi=true |