Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network

In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on geoscience and remote sensing 2021-01, Vol.59 (1), p.597-612
Hauptverfasser: Wan, Sheng, Gong, Chen, Zhong, Ping, Pan, Shirui, Li, Guangyu, Yang, Jian
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 612
container_issue 1
container_start_page 597
container_title IEEE transactions on geoscience and remote sensing
container_volume 59
creator Wan, Sheng
Gong, Chen
Zhong, Ping
Pan, Shirui
Li, Guangyu
Yang, Jian
description In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to correctly discover the contextual relations among pixels in complex situations, and thus leading to imperfect classification results on some irregular or inhomogeneous regions such as class boundaries. To address this deficiency, we develop a new HSI classification method based on the recently proposed graph convolutional network (GCN), as it can flexibly encode the relations among arbitrarily structured non-Euclidean data. Different from traditional GCN, there are two novel strategies adopted by our method to further exploit the contextual relations for accurate HSI classification. First, since the receptive field of traditional GCN is often limited to fairly small neighborhood, we proposed to capture long-range contextual relations in HSI by performing successive graph convolutions on a learned region-induced graph which is transformed from the original 2-D image grids. Second, we refine the graph edge weight and the connective relationships among image regions simultaneously by learning the improved similarity measurement and the "edge filter," so that the graph can be gradually refined to adapt to the representations generated by each graph convolutional layer. Such updated graph will in turn result in faithful region representations, and vice versa. The experiments carried out on four real-world benchmark data sets demonstrate the effectiveness of the proposed method.
doi_str_mv 10.1109/TGRS.2020.2994205
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2473270852</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9099071</ieee_id><sourcerecordid>2473270852</sourcerecordid><originalsourceid>FETCH-LOGICAL-c336t-6668895174bcd0f1f4a020330bca8ba1e35198f35ad7ef8fcaa23bb671f29d903</originalsourceid><addsrcrecordid>eNo9kE1PAjEQhhujiYj-AONlE8-L03Y_2iNZFUiIJooxnprZ0uoisGtbRP69u0I8zWGe983MQ8glhQGlIG9mo6fnAQMGAyZlwiA9Ij2apiKGLEmOSQ-ozGImJDslZ94vAGiS0rxH3sa7xjjfGB0cLqPJCt9NVCzR-8pWGkNVr6PXKnxERb0O5ifEwy06E93u1riqdDRy2PztvuvlpoPbjgcTtrX7PCcnFpfeXBxmn7zc382KcTx9HE2K4TTWnGchzrJMCNnekpR6DpbaBNsvOIdSoyiRGp5SKSxPcZ4bK6xGZLwss5xaJucSeJ9c73sbV39tjA9qUW9ce4hXLMk5y0GkrKXontKu9t4ZqxpXrdDtFAXVGVSdQdUZVAeDbeZqn6mMMf-8BCkhp_wXNsJtfw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2473270852</pqid></control><display><type>article</type><title>Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network</title><source>IEEE Electronic Library (IEL)</source><creator>Wan, Sheng ; Gong, Chen ; Zhong, Ping ; Pan, Shirui ; Li, Guangyu ; Yang, Jian</creator><creatorcontrib>Wan, Sheng ; Gong, Chen ; Zhong, Ping ; Pan, Shirui ; Li, Guangyu ; Yang, Jian</creatorcontrib><description>In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to correctly discover the contextual relations among pixels in complex situations, and thus leading to imperfect classification results on some irregular or inhomogeneous regions such as class boundaries. To address this deficiency, we develop a new HSI classification method based on the recently proposed graph convolutional network (GCN), as it can flexibly encode the relations among arbitrarily structured non-Euclidean data. Different from traditional GCN, there are two novel strategies adopted by our method to further exploit the contextual relations for accurate HSI classification. First, since the receptive field of traditional GCN is often limited to fairly small neighborhood, we proposed to capture long-range contextual relations in HSI by performing successive graph convolutions on a learned region-induced graph which is transformed from the original 2-D image grids. Second, we refine the graph edge weight and the connective relationships among image regions simultaneously by learning the improved similarity measurement and the "edge filter," so that the graph can be gradually refined to adapt to the representations generated by each graph convolutional layer. Such updated graph will in turn result in faithful region representations, and vice versa. The experiments carried out on four real-world benchmark data sets demonstrate the effectiveness of the proposed method.</description><identifier>ISSN: 0196-2892</identifier><identifier>EISSN: 1558-0644</identifier><identifier>DOI: 10.1109/TGRS.2020.2994205</identifier><identifier>CODEN: IGRSD2</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Artificial neural networks ; Classification ; Context ; Contextual relations ; Data mining ; Electronic mail ; Feature extraction ; graph convolutional network (GCN) ; graph updating ; Graphical representations ; hyperspectral image~(HIS) classification ; Hyperspectral imaging ; Image classification ; Image edge detection ; Land cover ; Nonhomogeneous media ; Pixels ; Receptive field ; Regions</subject><ispartof>IEEE transactions on geoscience and remote sensing, 2021-01, Vol.59 (1), p.597-612</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c336t-6668895174bcd0f1f4a020330bca8ba1e35198f35ad7ef8fcaa23bb671f29d903</citedby><cites>FETCH-LOGICAL-c336t-6668895174bcd0f1f4a020330bca8ba1e35198f35ad7ef8fcaa23bb671f29d903</cites><orcidid>0000-0003-4800-832X ; 0000-0003-0794-527X ; 0000-0003-4817-0618 ; 0000-0002-4092-9856 ; 0000-0003-0228-3449 ; 0000-0002-8686-3928</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9099071$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9099071$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Wan, Sheng</creatorcontrib><creatorcontrib>Gong, Chen</creatorcontrib><creatorcontrib>Zhong, Ping</creatorcontrib><creatorcontrib>Pan, Shirui</creatorcontrib><creatorcontrib>Li, Guangyu</creatorcontrib><creatorcontrib>Yang, Jian</creatorcontrib><title>Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network</title><title>IEEE transactions on geoscience and remote sensing</title><addtitle>TGRS</addtitle><description>In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to correctly discover the contextual relations among pixels in complex situations, and thus leading to imperfect classification results on some irregular or inhomogeneous regions such as class boundaries. To address this deficiency, we develop a new HSI classification method based on the recently proposed graph convolutional network (GCN), as it can flexibly encode the relations among arbitrarily structured non-Euclidean data. Different from traditional GCN, there are two novel strategies adopted by our method to further exploit the contextual relations for accurate HSI classification. First, since the receptive field of traditional GCN is often limited to fairly small neighborhood, we proposed to capture long-range contextual relations in HSI by performing successive graph convolutions on a learned region-induced graph which is transformed from the original 2-D image grids. Second, we refine the graph edge weight and the connective relationships among image regions simultaneously by learning the improved similarity measurement and the "edge filter," so that the graph can be gradually refined to adapt to the representations generated by each graph convolutional layer. Such updated graph will in turn result in faithful region representations, and vice versa. The experiments carried out on four real-world benchmark data sets demonstrate the effectiveness of the proposed method.</description><subject>Artificial neural networks</subject><subject>Classification</subject><subject>Context</subject><subject>Contextual relations</subject><subject>Data mining</subject><subject>Electronic mail</subject><subject>Feature extraction</subject><subject>graph convolutional network (GCN)</subject><subject>graph updating</subject><subject>Graphical representations</subject><subject>hyperspectral image~(HIS) classification</subject><subject>Hyperspectral imaging</subject><subject>Image classification</subject><subject>Image edge detection</subject><subject>Land cover</subject><subject>Nonhomogeneous media</subject><subject>Pixels</subject><subject>Receptive field</subject><subject>Regions</subject><issn>0196-2892</issn><issn>1558-0644</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1PAjEQhhujiYj-AONlE8-L03Y_2iNZFUiIJooxnprZ0uoisGtbRP69u0I8zWGe983MQ8glhQGlIG9mo6fnAQMGAyZlwiA9Ij2apiKGLEmOSQ-ozGImJDslZ94vAGiS0rxH3sa7xjjfGB0cLqPJCt9NVCzR-8pWGkNVr6PXKnxERb0O5ifEwy06E93u1riqdDRy2PztvuvlpoPbjgcTtrX7PCcnFpfeXBxmn7zc382KcTx9HE2K4TTWnGchzrJMCNnekpR6DpbaBNsvOIdSoyiRGp5SKSxPcZ4bK6xGZLwss5xaJucSeJ9c73sbV39tjA9qUW9ce4hXLMk5y0GkrKXontKu9t4ZqxpXrdDtFAXVGVSdQdUZVAeDbeZqn6mMMf-8BCkhp_wXNsJtfw</recordid><startdate>202101</startdate><enddate>202101</enddate><creator>Wan, Sheng</creator><creator>Gong, Chen</creator><creator>Zhong, Ping</creator><creator>Pan, Shirui</creator><creator>Li, Guangyu</creator><creator>Yang, Jian</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>FR3</scope><scope>H8D</scope><scope>H96</scope><scope>KR7</scope><scope>L.G</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0003-4800-832X</orcidid><orcidid>https://orcid.org/0000-0003-0794-527X</orcidid><orcidid>https://orcid.org/0000-0003-4817-0618</orcidid><orcidid>https://orcid.org/0000-0002-4092-9856</orcidid><orcidid>https://orcid.org/0000-0003-0228-3449</orcidid><orcidid>https://orcid.org/0000-0002-8686-3928</orcidid></search><sort><creationdate>202101</creationdate><title>Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network</title><author>Wan, Sheng ; Gong, Chen ; Zhong, Ping ; Pan, Shirui ; Li, Guangyu ; Yang, Jian</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c336t-6668895174bcd0f1f4a020330bca8ba1e35198f35ad7ef8fcaa23bb671f29d903</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Artificial neural networks</topic><topic>Classification</topic><topic>Context</topic><topic>Contextual relations</topic><topic>Data mining</topic><topic>Electronic mail</topic><topic>Feature extraction</topic><topic>graph convolutional network (GCN)</topic><topic>graph updating</topic><topic>Graphical representations</topic><topic>hyperspectral image~(HIS) classification</topic><topic>Hyperspectral imaging</topic><topic>Image classification</topic><topic>Image edge detection</topic><topic>Land cover</topic><topic>Nonhomogeneous media</topic><topic>Pixels</topic><topic>Receptive field</topic><topic>Regions</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wan, Sheng</creatorcontrib><creatorcontrib>Gong, Chen</creatorcontrib><creatorcontrib>Zhong, Ping</creatorcontrib><creatorcontrib>Pan, Shirui</creatorcontrib><creatorcontrib>Li, Guangyu</creatorcontrib><creatorcontrib>Yang, Jian</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on geoscience and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wan, Sheng</au><au>Gong, Chen</au><au>Zhong, Ping</au><au>Pan, Shirui</au><au>Li, Guangyu</au><au>Yang, Jian</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network</atitle><jtitle>IEEE transactions on geoscience and remote sensing</jtitle><stitle>TGRS</stitle><date>2021-01</date><risdate>2021</risdate><volume>59</volume><issue>1</issue><spage>597</spage><epage>612</epage><pages>597-612</pages><issn>0196-2892</issn><eissn>1558-0644</eissn><coden>IGRSD2</coden><abstract>In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should correspond to the same land-cover class, so they often fail to correctly discover the contextual relations among pixels in complex situations, and thus leading to imperfect classification results on some irregular or inhomogeneous regions such as class boundaries. To address this deficiency, we develop a new HSI classification method based on the recently proposed graph convolutional network (GCN), as it can flexibly encode the relations among arbitrarily structured non-Euclidean data. Different from traditional GCN, there are two novel strategies adopted by our method to further exploit the contextual relations for accurate HSI classification. First, since the receptive field of traditional GCN is often limited to fairly small neighborhood, we proposed to capture long-range contextual relations in HSI by performing successive graph convolutions on a learned region-induced graph which is transformed from the original 2-D image grids. Second, we refine the graph edge weight and the connective relationships among image regions simultaneously by learning the improved similarity measurement and the "edge filter," so that the graph can be gradually refined to adapt to the representations generated by each graph convolutional layer. Such updated graph will in turn result in faithful region representations, and vice versa. The experiments carried out on four real-world benchmark data sets demonstrate the effectiveness of the proposed method.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TGRS.2020.2994205</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0003-4800-832X</orcidid><orcidid>https://orcid.org/0000-0003-0794-527X</orcidid><orcidid>https://orcid.org/0000-0003-4817-0618</orcidid><orcidid>https://orcid.org/0000-0002-4092-9856</orcidid><orcidid>https://orcid.org/0000-0003-0228-3449</orcidid><orcidid>https://orcid.org/0000-0002-8686-3928</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0196-2892
ispartof IEEE transactions on geoscience and remote sensing, 2021-01, Vol.59 (1), p.597-612
issn 0196-2892
1558-0644
language eng
recordid cdi_proquest_journals_2473270852
source IEEE Electronic Library (IEL)
subjects Artificial neural networks
Classification
Context
Contextual relations
Data mining
Electronic mail
Feature extraction
graph convolutional network (GCN)
graph updating
Graphical representations
hyperspectral image~(HIS) classification
Hyperspectral imaging
Image classification
Image edge detection
Land cover
Nonhomogeneous media
Pixels
Receptive field
Regions
title Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T13%3A04%3A48IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Hyperspectral%20Image%20Classification%20With%20Context-Aware%20Dynamic%20Graph%20Convolutional%20Network&rft.jtitle=IEEE%20transactions%20on%20geoscience%20and%20remote%20sensing&rft.au=Wan,%20Sheng&rft.date=2021-01&rft.volume=59&rft.issue=1&rft.spage=597&rft.epage=612&rft.pages=597-612&rft.issn=0196-2892&rft.eissn=1558-0644&rft.coden=IGRSD2&rft_id=info:doi/10.1109/TGRS.2020.2994205&rft_dat=%3Cproquest_RIE%3E2473270852%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2473270852&rft_id=info:pmid/&rft_ieee_id=9099071&rfr_iscdi=true