CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes

High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream det...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Neural computing & applications 2023-04, Vol.35 (11), p.8227-8241
Hauptverfasser: Lin, Yijun, Wu, Fengge, Zhao, Junsuo
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 8241
container_issue 11
container_start_page 8227
container_title Neural computing & applications
container_volume 35
creator Lin, Yijun
Wu, Fengge
Zhao, Junsuo
description High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.
doi_str_mv 10.1007/s00521-022-08096-2
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2789009852</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2789009852</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</originalsourceid><addsrcrecordid>eNp9UD1PwzAUtBBIlMIfYLLEbHjxV2w2VCggVWKBARbLcew2JU2KnQ7w63EJEhvT0727ex-H0HkBlwVAeZUABC0IUEpAgZaEHqBJwRkjDIQ6RBPQPNOSs2N0ktIaALhUYoJeZ7dvfb-5xhavdhvbkbZ59zj5j53vhsa2-Cuz2C4zwqGP2IfQuGaP3Mp2S49rP3g3NH2Hmw63NuZWcr7z6RQdBdsmf_Zbp-hlfvc8eyCLp_vH2c2COFrCQIpCcl57WStptQJQmvFKCiqUcExQ7512VSg1l6IuZagd1MGW0ipRVZ5JwaboYpy7jX2-Og1m3e9il1caWioNoJWgWUVHlYt9StEHs43NxsZPU4DZR2jGCE2O0PxEaPYmNppSFudn49_of1zf7Ftziw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2789009852</pqid></control><display><type>article</type><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><source>SpringerNature Journals</source><creator>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</creator><creatorcontrib>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</creatorcontrib><description>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</description><identifier>ISSN: 0941-0643</identifier><identifier>EISSN: 1433-3058</identifier><identifier>DOI: 10.1007/s00521-022-08096-2</identifier><language>eng</language><publisher>London: Springer London</publisher><subject>Accuracy ; Artificial Intelligence ; Change detection ; Coders ; Computational Biology/Bioinformatics ; Computational Science and Engineering ; Computer Science ; Curricula ; Data Mining and Knowledge Discovery ; Datasets ; Distillation ; Image Processing and Computer Vision ; Image resolution ; Original Article ; Probability and Statistics in Computer Science ; Regions ; Remote sensing ; Sensors ; Sequential sampling ; Task complexity ; Zooming</subject><ispartof>Neural computing &amp; applications, 2023-04, Vol.35 (11), p.8227-8241</ispartof><rights>The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2022. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</cites><orcidid>0000-0001-8173-7116</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00521-022-08096-2$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00521-022-08096-2$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Lin, Yijun</creatorcontrib><creatorcontrib>Wu, Fengge</creatorcontrib><creatorcontrib>Zhao, Junsuo</creatorcontrib><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><title>Neural computing &amp; applications</title><addtitle>Neural Comput &amp; Applic</addtitle><description>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</description><subject>Accuracy</subject><subject>Artificial Intelligence</subject><subject>Change detection</subject><subject>Coders</subject><subject>Computational Biology/Bioinformatics</subject><subject>Computational Science and Engineering</subject><subject>Computer Science</subject><subject>Curricula</subject><subject>Data Mining and Knowledge Discovery</subject><subject>Datasets</subject><subject>Distillation</subject><subject>Image Processing and Computer Vision</subject><subject>Image resolution</subject><subject>Original Article</subject><subject>Probability and Statistics in Computer Science</subject><subject>Regions</subject><subject>Remote sensing</subject><subject>Sensors</subject><subject>Sequential sampling</subject><subject>Task complexity</subject><subject>Zooming</subject><issn>0941-0643</issn><issn>1433-3058</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>AFKRA</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNp9UD1PwzAUtBBIlMIfYLLEbHjxV2w2VCggVWKBARbLcew2JU2KnQ7w63EJEhvT0727ex-H0HkBlwVAeZUABC0IUEpAgZaEHqBJwRkjDIQ6RBPQPNOSs2N0ktIaALhUYoJeZ7dvfb-5xhavdhvbkbZ59zj5j53vhsa2-Cuz2C4zwqGP2IfQuGaP3Mp2S49rP3g3NH2Hmw63NuZWcr7z6RQdBdsmf_Zbp-hlfvc8eyCLp_vH2c2COFrCQIpCcl57WStptQJQmvFKCiqUcExQ7512VSg1l6IuZagd1MGW0ipRVZ5JwaboYpy7jX2-Og1m3e9il1caWioNoJWgWUVHlYt9StEHs43NxsZPU4DZR2jGCE2O0PxEaPYmNppSFudn49_of1zf7Ftziw</recordid><startdate>20230401</startdate><enddate>20230401</enddate><creator>Lin, Yijun</creator><creator>Wu, Fengge</creator><creator>Zhao, Junsuo</creator><general>Springer London</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><orcidid>https://orcid.org/0000-0001-8173-7116</orcidid></search><sort><creationdate>20230401</creationdate><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><author>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Artificial Intelligence</topic><topic>Change detection</topic><topic>Coders</topic><topic>Computational Biology/Bioinformatics</topic><topic>Computational Science and Engineering</topic><topic>Computer Science</topic><topic>Curricula</topic><topic>Data Mining and Knowledge Discovery</topic><topic>Datasets</topic><topic>Distillation</topic><topic>Image Processing and Computer Vision</topic><topic>Image resolution</topic><topic>Original Article</topic><topic>Probability and Statistics in Computer Science</topic><topic>Regions</topic><topic>Remote sensing</topic><topic>Sensors</topic><topic>Sequential sampling</topic><topic>Task complexity</topic><topic>Zooming</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lin, Yijun</creatorcontrib><creatorcontrib>Wu, Fengge</creatorcontrib><creatorcontrib>Zhao, Junsuo</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Neural computing &amp; applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lin, Yijun</au><au>Wu, Fengge</au><au>Zhao, Junsuo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</atitle><jtitle>Neural computing &amp; applications</jtitle><stitle>Neural Comput &amp; Applic</stitle><date>2023-04-01</date><risdate>2023</risdate><volume>35</volume><issue>11</issue><spage>8227</spage><epage>8241</epage><pages>8227-8241</pages><issn>0941-0643</issn><eissn>1433-3058</eissn><abstract>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</abstract><cop>London</cop><pub>Springer London</pub><doi>10.1007/s00521-022-08096-2</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0001-8173-7116</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0941-0643
ispartof Neural computing & applications, 2023-04, Vol.35 (11), p.8227-8241
issn 0941-0643
1433-3058
language eng
recordid cdi_proquest_journals_2789009852
source SpringerNature Journals
subjects Accuracy
Artificial Intelligence
Change detection
Coders
Computational Biology/Bioinformatics
Computational Science and Engineering
Computer Science
Curricula
Data Mining and Knowledge Discovery
Datasets
Distillation
Image Processing and Computer Vision
Image resolution
Original Article
Probability and Statistics in Computer Science
Regions
Remote sensing
Sensors
Sequential sampling
Task complexity
Zooming
title CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T19%3A38%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CDZoom:%20a%20human-like%20sequential%20zoom%20agent%20for%20efficient%20change%20detection%20in%20large%20scenes&rft.jtitle=Neural%20computing%20&%20applications&rft.au=Lin,%20Yijun&rft.date=2023-04-01&rft.volume=35&rft.issue=11&rft.spage=8227&rft.epage=8241&rft.pages=8227-8241&rft.issn=0941-0643&rft.eissn=1433-3058&rft_id=info:doi/10.1007/s00521-022-08096-2&rft_dat=%3Cproquest_cross%3E2789009852%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2789009852&rft_id=info:pmid/&rfr_iscdi=true