CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes
High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream det...
Gespeichert in:
Veröffentlicht in: | Neural computing & applications 2023-04, Vol.35 (11), p.8227-8241 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 8241 |
---|---|
container_issue | 11 |
container_start_page | 8227 |
container_title | Neural computing & applications |
container_volume | 35 |
creator | Lin, Yijun Wu, Fengge Zhao, Junsuo |
description | High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images. |
doi_str_mv | 10.1007/s00521-022-08096-2 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2789009852</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2789009852</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</originalsourceid><addsrcrecordid>eNp9UD1PwzAUtBBIlMIfYLLEbHjxV2w2VCggVWKBARbLcew2JU2KnQ7w63EJEhvT0727ex-H0HkBlwVAeZUABC0IUEpAgZaEHqBJwRkjDIQ6RBPQPNOSs2N0ktIaALhUYoJeZ7dvfb-5xhavdhvbkbZ59zj5j53vhsa2-Cuz2C4zwqGP2IfQuGaP3Mp2S49rP3g3NH2Hmw63NuZWcr7z6RQdBdsmf_Zbp-hlfvc8eyCLp_vH2c2COFrCQIpCcl57WStptQJQmvFKCiqUcExQ7512VSg1l6IuZagd1MGW0ipRVZ5JwaboYpy7jX2-Og1m3e9il1caWioNoJWgWUVHlYt9StEHs43NxsZPU4DZR2jGCE2O0PxEaPYmNppSFudn49_of1zf7Ftziw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2789009852</pqid></control><display><type>article</type><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><source>SpringerNature Journals</source><creator>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</creator><creatorcontrib>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</creatorcontrib><description>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</description><identifier>ISSN: 0941-0643</identifier><identifier>EISSN: 1433-3058</identifier><identifier>DOI: 10.1007/s00521-022-08096-2</identifier><language>eng</language><publisher>London: Springer London</publisher><subject>Accuracy ; Artificial Intelligence ; Change detection ; Coders ; Computational Biology/Bioinformatics ; Computational Science and Engineering ; Computer Science ; Curricula ; Data Mining and Knowledge Discovery ; Datasets ; Distillation ; Image Processing and Computer Vision ; Image resolution ; Original Article ; Probability and Statistics in Computer Science ; Regions ; Remote sensing ; Sensors ; Sequential sampling ; Task complexity ; Zooming</subject><ispartof>Neural computing & applications, 2023-04, Vol.35 (11), p.8227-8241</ispartof><rights>The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2022. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</cites><orcidid>0000-0001-8173-7116</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00521-022-08096-2$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00521-022-08096-2$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Lin, Yijun</creatorcontrib><creatorcontrib>Wu, Fengge</creatorcontrib><creatorcontrib>Zhao, Junsuo</creatorcontrib><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><title>Neural computing & applications</title><addtitle>Neural Comput & Applic</addtitle><description>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</description><subject>Accuracy</subject><subject>Artificial Intelligence</subject><subject>Change detection</subject><subject>Coders</subject><subject>Computational Biology/Bioinformatics</subject><subject>Computational Science and Engineering</subject><subject>Computer Science</subject><subject>Curricula</subject><subject>Data Mining and Knowledge Discovery</subject><subject>Datasets</subject><subject>Distillation</subject><subject>Image Processing and Computer Vision</subject><subject>Image resolution</subject><subject>Original Article</subject><subject>Probability and Statistics in Computer Science</subject><subject>Regions</subject><subject>Remote sensing</subject><subject>Sensors</subject><subject>Sequential sampling</subject><subject>Task complexity</subject><subject>Zooming</subject><issn>0941-0643</issn><issn>1433-3058</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>AFKRA</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNp9UD1PwzAUtBBIlMIfYLLEbHjxV2w2VCggVWKBARbLcew2JU2KnQ7w63EJEhvT0727ex-H0HkBlwVAeZUABC0IUEpAgZaEHqBJwRkjDIQ6RBPQPNOSs2N0ktIaALhUYoJeZ7dvfb-5xhavdhvbkbZ59zj5j53vhsa2-Cuz2C4zwqGP2IfQuGaP3Mp2S49rP3g3NH2Hmw63NuZWcr7z6RQdBdsmf_Zbp-hlfvc8eyCLp_vH2c2COFrCQIpCcl57WStptQJQmvFKCiqUcExQ7512VSg1l6IuZagd1MGW0ipRVZ5JwaboYpy7jX2-Og1m3e9il1caWioNoJWgWUVHlYt9StEHs43NxsZPU4DZR2jGCE2O0PxEaPYmNppSFudn49_of1zf7Ftziw</recordid><startdate>20230401</startdate><enddate>20230401</enddate><creator>Lin, Yijun</creator><creator>Wu, Fengge</creator><creator>Zhao, Junsuo</creator><general>Springer London</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><orcidid>https://orcid.org/0000-0001-8173-7116</orcidid></search><sort><creationdate>20230401</creationdate><title>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</title><author>Lin, Yijun ; Wu, Fengge ; Zhao, Junsuo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-11644de6d86a98008934b652585c352eec9cbf79465d76fdc0dfa76a85bbe3653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Artificial Intelligence</topic><topic>Change detection</topic><topic>Coders</topic><topic>Computational Biology/Bioinformatics</topic><topic>Computational Science and Engineering</topic><topic>Computer Science</topic><topic>Curricula</topic><topic>Data Mining and Knowledge Discovery</topic><topic>Datasets</topic><topic>Distillation</topic><topic>Image Processing and Computer Vision</topic><topic>Image resolution</topic><topic>Original Article</topic><topic>Probability and Statistics in Computer Science</topic><topic>Regions</topic><topic>Remote sensing</topic><topic>Sensors</topic><topic>Sequential sampling</topic><topic>Task complexity</topic><topic>Zooming</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lin, Yijun</creatorcontrib><creatorcontrib>Wu, Fengge</creatorcontrib><creatorcontrib>Zhao, Junsuo</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Neural computing & applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lin, Yijun</au><au>Wu, Fengge</au><au>Zhao, Junsuo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes</atitle><jtitle>Neural computing & applications</jtitle><stitle>Neural Comput & Applic</stitle><date>2023-04-01</date><risdate>2023</risdate><volume>35</volume><issue>11</issue><spage>8227</spage><epage>8241</epage><pages>8227-8241</pages><issn>0941-0643</issn><eissn>1433-3058</eissn><abstract>High-resolution (HR) remote sensing images provide rich information for human activities. However, processing entire HR images is time-consuming, and many computations are meaningless for change detection tasks since objects often cluster in local regions. To alleviate the pressure of downstream detectors, previous studies introduce a regional attention process to roughly sample candidate patches, but most solutions are tailored to particular tasks and datasets. Motivated by these, we develop a novel reinforcement learning sampling framework, and train a human-like agent, named CDZoom, to locate regions of interest by simulating human zooming behaviors. To be specific, the proposed network consists of an encoder block, multiple context blocks and a decision block. It speeds up sequential sampling operations by gradually focusing the scope of observed scene and increasing the resolution. To avoid the sparse reward problem when learning complex sampling tasks, we introduce a novel training paradigm based on curriculum learning and policy distillation. The proposed CDZoom can sample multi-size patches from multi-scale scenes, and thus generalizes well to different requirements. Experiments on public change detection datasets demonstrate the effectiveness of our method. CDZoom can reduce the computational cost by over 50%, while maintaining similar detection accuracy to models which use full HR images.</abstract><cop>London</cop><pub>Springer London</pub><doi>10.1007/s00521-022-08096-2</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0001-8173-7116</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0941-0643 |
ispartof | Neural computing & applications, 2023-04, Vol.35 (11), p.8227-8241 |
issn | 0941-0643 1433-3058 |
language | eng |
recordid | cdi_proquest_journals_2789009852 |
source | SpringerNature Journals |
subjects | Accuracy Artificial Intelligence Change detection Coders Computational Biology/Bioinformatics Computational Science and Engineering Computer Science Curricula Data Mining and Knowledge Discovery Datasets Distillation Image Processing and Computer Vision Image resolution Original Article Probability and Statistics in Computer Science Regions Remote sensing Sensors Sequential sampling Task complexity Zooming |
title | CDZoom: a human-like sequential zoom agent for efficient change detection in large scenes |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T19%3A38%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CDZoom:%20a%20human-like%20sequential%20zoom%20agent%20for%20efficient%20change%20detection%20in%20large%20scenes&rft.jtitle=Neural%20computing%20&%20applications&rft.au=Lin,%20Yijun&rft.date=2023-04-01&rft.volume=35&rft.issue=11&rft.spage=8227&rft.epage=8241&rft.pages=8227-8241&rft.issn=0941-0643&rft.eissn=1433-3058&rft_id=info:doi/10.1007/s00521-022-08096-2&rft_dat=%3Cproquest_cross%3E2789009852%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2789009852&rft_id=info:pmid/&rfr_iscdi=true |