RCDT: Relational Remote Sensing Change Detection with Transformer

Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing modules, i.e., semantic enhancement, attention mechanisms, and cor...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lu, Kaixuan, Huang, Xiao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Lu, Kaixuan
Huang, Xiao
description Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing modules, i.e., semantic enhancement, attention mechanisms, and correspondence enhancement. The stacking of these modules leads to great model complexity. To unify these three modules into a simple pipeline, we introduce Relational Change Detection Transformer (RCDT), a novel and simple framework for remote sensing change detection tasks. The proposed RCDT consists of three major components, a weight-sharing Siamese Backbone to obtain bi-temporal features, a Relational Cross Attention Module (RCAM) that implements offset cross attention to obtain bi-temporal relation-aware features, and a Features Constrain Module (FCM) to achieve the final refined predictions with high-resolution constraints. Extensive experiments on four different publically available datasets suggest that our proposed RCDT exhibits superior change detection performance compared with other competing methods. The therotical, methodogical, and experimental knowledge of this study is expected to benefit future change detection efforts that involve the cross attention mechanism.
doi_str_mv 10.48550/arxiv.2212.04869
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2212_04869</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2212_04869</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-f59ff8fc37f6cd9883c29fd3cb6b4e1fe72d38cc6570be87b84ee3cbfd755aa23</originalsourceid><addsrcrecordid>eNotj8tqwzAURLXpoqT9gK6qH7BrS9aru-D0BYFC6r25lu9NBLZcZNPH3zdJs5qBOQwcxu7KIq-sUsUDpJ_wlQtRiryorHbXbL2rN80j3-EAS5giDMc6TgvyD4xziHteHyDukW9wQX8i-HdYDrxJEGea0ojphl0RDDPeXnLFmuenpn7Ntu8vb_V6m4E2LiPliCx5aUj73lkrvXDUS9_prsKS0IheWu-1MkWH1nS2Qjyu1BulAIRcsfv_27ND-5nCCOm3Pbm0Zxf5B1cdRRQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>RCDT: Relational Remote Sensing Change Detection with Transformer</title><source>arXiv.org</source><creator>Lu, Kaixuan ; Huang, Xiao</creator><creatorcontrib>Lu, Kaixuan ; Huang, Xiao</creatorcontrib><description>Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing modules, i.e., semantic enhancement, attention mechanisms, and correspondence enhancement. The stacking of these modules leads to great model complexity. To unify these three modules into a simple pipeline, we introduce Relational Change Detection Transformer (RCDT), a novel and simple framework for remote sensing change detection tasks. The proposed RCDT consists of three major components, a weight-sharing Siamese Backbone to obtain bi-temporal features, a Relational Cross Attention Module (RCAM) that implements offset cross attention to obtain bi-temporal relation-aware features, and a Features Constrain Module (FCM) to achieve the final refined predictions with high-resolution constraints. Extensive experiments on four different publically available datasets suggest that our proposed RCDT exhibits superior change detection performance compared with other competing methods. The therotical, methodogical, and experimental knowledge of this study is expected to benefit future change detection efforts that involve the cross attention mechanism.</description><identifier>DOI: 10.48550/arxiv.2212.04869</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2022-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2212.04869$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2212.04869$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Lu, Kaixuan</creatorcontrib><creatorcontrib>Huang, Xiao</creatorcontrib><title>RCDT: Relational Remote Sensing Change Detection with Transformer</title><description>Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing modules, i.e., semantic enhancement, attention mechanisms, and correspondence enhancement. The stacking of these modules leads to great model complexity. To unify these three modules into a simple pipeline, we introduce Relational Change Detection Transformer (RCDT), a novel and simple framework for remote sensing change detection tasks. The proposed RCDT consists of three major components, a weight-sharing Siamese Backbone to obtain bi-temporal features, a Relational Cross Attention Module (RCAM) that implements offset cross attention to obtain bi-temporal relation-aware features, and a Features Constrain Module (FCM) to achieve the final refined predictions with high-resolution constraints. Extensive experiments on four different publically available datasets suggest that our proposed RCDT exhibits superior change detection performance compared with other competing methods. The therotical, methodogical, and experimental knowledge of this study is expected to benefit future change detection efforts that involve the cross attention mechanism.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj8tqwzAURLXpoqT9gK6qH7BrS9aru-D0BYFC6r25lu9NBLZcZNPH3zdJs5qBOQwcxu7KIq-sUsUDpJ_wlQtRiryorHbXbL2rN80j3-EAS5giDMc6TgvyD4xziHteHyDukW9wQX8i-HdYDrxJEGea0ojphl0RDDPeXnLFmuenpn7Ntu8vb_V6m4E2LiPliCx5aUj73lkrvXDUS9_prsKS0IheWu-1MkWH1nS2Qjyu1BulAIRcsfv_27ND-5nCCOm3Pbm0Zxf5B1cdRRQ</recordid><startdate>20221209</startdate><enddate>20221209</enddate><creator>Lu, Kaixuan</creator><creator>Huang, Xiao</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20221209</creationdate><title>RCDT: Relational Remote Sensing Change Detection with Transformer</title><author>Lu, Kaixuan ; Huang, Xiao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-f59ff8fc37f6cd9883c29fd3cb6b4e1fe72d38cc6570be87b84ee3cbfd755aa23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Lu, Kaixuan</creatorcontrib><creatorcontrib>Huang, Xiao</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Lu, Kaixuan</au><au>Huang, Xiao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RCDT: Relational Remote Sensing Change Detection with Transformer</atitle><date>2022-12-09</date><risdate>2022</risdate><abstract>Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing modules, i.e., semantic enhancement, attention mechanisms, and correspondence enhancement. The stacking of these modules leads to great model complexity. To unify these three modules into a simple pipeline, we introduce Relational Change Detection Transformer (RCDT), a novel and simple framework for remote sensing change detection tasks. The proposed RCDT consists of three major components, a weight-sharing Siamese Backbone to obtain bi-temporal features, a Relational Cross Attention Module (RCAM) that implements offset cross attention to obtain bi-temporal relation-aware features, and a Features Constrain Module (FCM) to achieve the final refined predictions with high-resolution constraints. Extensive experiments on four different publically available datasets suggest that our proposed RCDT exhibits superior change detection performance compared with other competing methods. The therotical, methodogical, and experimental knowledge of this study is expected to benefit future change detection efforts that involve the cross attention mechanism.</abstract><doi>10.48550/arxiv.2212.04869</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2212.04869
ispartof
issn
language eng
recordid cdi_arxiv_primary_2212_04869
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
title RCDT: Relational Remote Sensing Change Detection with Transformer
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T04%3A49%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RCDT:%20Relational%20Remote%20Sensing%20Change%20Detection%20with%20Transformer&rft.au=Lu,%20Kaixuan&rft.date=2022-12-09&rft_id=info:doi/10.48550/arxiv.2212.04869&rft_dat=%3Carxiv_GOX%3E2212_04869%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true