MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection

The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal ch...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE journal of selected topics in applied earth observations and remote sensing 2023-03, p.1-12
Hauptverfasser: Li, Hao, Liu, Xiaoyong, Li, Huihui, Dong, Ziyang, Xiao, Xiangling
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 12
container_issue
container_start_page 1
container_title IEEE journal of selected topics in applied earth observations and remote sensing
container_volume
creator Li, Hao
Liu, Xiaoyong
Li, Huihui
Dong, Ziyang
Xiao, Xiangling
description The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.
doi_str_mv 10.1109/JSTARS.2023.3260006
format Article
fullrecord <record><control><sourceid>ieee</sourceid><recordid>TN_cdi_ieee_primary_10078073</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10078073</ieee_id><sourcerecordid>10078073</sourcerecordid><originalsourceid>FETCH-ieee_primary_100780733</originalsourceid><addsrcrecordid>eNqFjLFuwjAYhD1QqdD2Ccrwv0DC7xgRwoYgEapEB8KOrOgChsRBjhHi7fHAznS6--5OiF_JsZScTf7K_XJXxgknKlbJjJlnAzGUmcoiOeXppxj1_TmESZqpodDbdZH_wy9oSdtb401UVroBrU1dw8FWoALa3xwotycdfAvrKSzunbtQ3Tnaoe08qITtjT3SKrSO4QAelTed_RYftW56_Lz0S4yLfL_aRAbA4epMq93jIJnTOadKvcFPJPJDxw</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</creator><creatorcontrib>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</creatorcontrib><description>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</description><identifier>ISSN: 1939-1404</identifier><identifier>DOI: 10.1109/JSTARS.2023.3260006</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>IEEE</publisher><subject>Attention mechanism ; change detection (CD) ; Computer vision ; convolutional neural networks (CNNs) ; Decoding ; feature enhancement ; Feature extraction ; Measurement ; pseudo changes ; Remote sensing ; Task analysis ; Transformers</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2023-03, p.1-12</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0003-0463-8178 ; 0000-0002-0795-841X ; 0000-0001-6226-5459</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,864,27924,27925</link.rule.ids></links><search><creatorcontrib>Li, Hao</creatorcontrib><creatorcontrib>Liu, Xiaoyong</creatorcontrib><creatorcontrib>Li, Huihui</creatorcontrib><creatorcontrib>Dong, Ziyang</creatorcontrib><creatorcontrib>Xiao, Xiangling</creatorcontrib><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</description><subject>Attention mechanism</subject><subject>change detection (CD)</subject><subject>Computer vision</subject><subject>convolutional neural networks (CNNs)</subject><subject>Decoding</subject><subject>feature enhancement</subject><subject>Feature extraction</subject><subject>Measurement</subject><subject>pseudo changes</subject><subject>Remote sensing</subject><subject>Task analysis</subject><subject>Transformers</subject><issn>1939-1404</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><recordid>eNqFjLFuwjAYhD1QqdD2Ccrwv0DC7xgRwoYgEapEB8KOrOgChsRBjhHi7fHAznS6--5OiF_JsZScTf7K_XJXxgknKlbJjJlnAzGUmcoiOeXppxj1_TmESZqpodDbdZH_wy9oSdtb401UVroBrU1dw8FWoALa3xwotycdfAvrKSzunbtQ3Tnaoe08qITtjT3SKrSO4QAelTed_RYftW56_Lz0S4yLfL_aRAbA4epMq93jIJnTOadKvcFPJPJDxw</recordid><startdate>20230321</startdate><enddate>20230321</enddate><creator>Li, Hao</creator><creator>Liu, Xiaoyong</creator><creator>Li, Huihui</creator><creator>Dong, Ziyang</creator><creator>Xiao, Xiangling</creator><general>IEEE</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><orcidid>https://orcid.org/0000-0003-0463-8178</orcidid><orcidid>https://orcid.org/0000-0002-0795-841X</orcidid><orcidid>https://orcid.org/0000-0001-6226-5459</orcidid></search><sort><creationdate>20230321</creationdate><title>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</title><author>Li, Hao ; Liu, Xiaoyong ; Li, Huihui ; Dong, Ziyang ; Xiao, Xiangling</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-ieee_primary_100780733</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Attention mechanism</topic><topic>change detection (CD)</topic><topic>Computer vision</topic><topic>convolutional neural networks (CNNs)</topic><topic>Decoding</topic><topic>feature enhancement</topic><topic>Feature extraction</topic><topic>Measurement</topic><topic>pseudo changes</topic><topic>Remote sensing</topic><topic>Task analysis</topic><topic>Transformers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Hao</creatorcontrib><creatorcontrib>Liu, Xiaoyong</creatorcontrib><creatorcontrib>Li, Huihui</creatorcontrib><creatorcontrib>Dong, Ziyang</creatorcontrib><creatorcontrib>Xiao, Xiangling</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Hao</au><au>Liu, Xiaoyong</au><au>Li, Huihui</au><au>Dong, Ziyang</au><au>Xiao, Xiangling</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2023-03-21</date><risdate>2023</risdate><spage>1</spage><epage>12</epage><pages>1-12</pages><issn>1939-1404</issn><coden>IJSTHZ</coden><abstract>The main task of remote sensing change detection (CD) is to identify object differences in bitemporal remote sensing images. In recent years, methods based on deep convolutional neural networks (CNNs) have made great progress in remote sensing CD. However, due to illumination changes and seasonal changes in the images acquired by the same sensor, the problem of "pseudo change" in the change map is still difficult to solve. In this article, in order to reduce "pseudo changes," we propose a multi-scale difference feature enhancement network (MDFENet) to extract the most discriminative features from bitemporal remote sensing images. MDFENet contains three procedures: first, multi-scale bitemporal features are generated by a shared weighted Siamese encoder. Then features of each scale are fed into a difference enhancement module to generate refined difference features. Finally, they are combined and reconstructed by a decoder to generate change map. The difference enhancement module includes multiple layers of difference enhancement (DE) encoder and transformer decoder. They are applied to features of different scales to establish long-range relationships of pixels semantic changes, while high-level difference features participate in the generation of low-level difference features to enhance information transmission among features of different scales, reducing "pseudo changes". Compared with state-of-the-art methods, the proposed method achieved the best performance on two datasets, with F1 of 81.15% on the SYSU-CD dataset and 90.85% on the LEVIR-CD dataset.</abstract><pub>IEEE</pub><doi>10.1109/JSTARS.2023.3260006</doi><orcidid>https://orcid.org/0000-0003-0463-8178</orcidid><orcidid>https://orcid.org/0000-0002-0795-841X</orcidid><orcidid>https://orcid.org/0000-0001-6226-5459</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1939-1404
ispartof IEEE journal of selected topics in applied earth observations and remote sensing, 2023-03, p.1-12
issn 1939-1404
language eng
recordid cdi_ieee_primary_10078073
source DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals
subjects Attention mechanism
change detection (CD)
Computer vision
convolutional neural networks (CNNs)
Decoding
feature enhancement
Feature extraction
Measurement
pseudo changes
Remote sensing
Task analysis
Transformers
title MDFENet: A Multi-Scale Difference Feature Enhancement Network for Remote Sensing Change Detection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T05%3A31%3A18IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MDFENet:%20A%20Multi-Scale%20Difference%20Feature%20Enhancement%20Network%20for%20Remote%20Sensing%20Change%20Detection&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Li,%20Hao&rft.date=2023-03-21&rft.spage=1&rft.epage=12&rft.pages=1-12&rft.issn=1939-1404&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2023.3260006&rft_dat=%3Cieee%3E10078073%3C/ieee%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10078073&rfr_iscdi=true