Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint

Multi-view feature fusion is a vital phase for multi-view representation learning. Recently, most Graph Auto-Encoders (GAEs) and their variants focus on multi-view learning. However, most of them ignore deep representation fusion of features of each multi-view. Furthermore, there are scarcely unsupe...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Knowledge-based systems 2021-11, Vol.231, p.107439, Article 107439
Hauptverfasser: Zhang, Xiaobo, Yang, Yan, Zhai, Donghai, Li, Tianrui, Chu, Jielei, Wang, Hao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 107439
container_title Knowledge-based systems
container_volume 231
creator Zhang, Xiaobo
Yang, Yan
Zhai, Donghai
Li, Tianrui
Chu, Jielei
Wang, Hao
description Multi-view feature fusion is a vital phase for multi-view representation learning. Recently, most Graph Auto-Encoders (GAEs) and their variants focus on multi-view learning. However, most of them ignore deep representation fusion of features of each multi-view. Furthermore, there are scarcely unsupervised constraints guiding to enhance the graph representation capability in training process. In this paper, we propose a novel unsupervised Multi-view Deep Graph Representation Learning (MDGRL) framework on multi-view data which is based on the Graph Auto-Encoders (GAEs) for local feature leaning, a feature fusion module for producing global representation and a valid variant of Variational Graph Auto-Encoder (VGAE) for global deep graph representation learning. To fuse Nearest Neighbor Constraint (NNC) between the maximal degree nodes which represents the most close joining node and their adjacent nodes into VGAE, we propose a new Nearest Neighbor Constraint Variational Graph Auto-Encoder (NNC-VGAE) to enhance the global deep graph representation capability for multi-view data. In the training process of NNC-VGAE, NNC makes the adjacent nodes gradually close to the maximal degree node. Hence, the proposed MDGRL has excellent deep graph representation capability for multi-view data. Experiments on eight non-medical benchmark multi-view data sets and four medical data sets confirm the effectiveness of our MDGRL compared with other state-of-the-art methods for unsupervised clustering. •Fusing all features of single-view graph into a multi-view global graph feature.•Providing a new Nearest Neighbor Constraint Variational Graph Auto-Encoder.•Proposing a Mutli-view Deep Graph Representation Learning (MDGRL) framework.•Proving that MDGRL framework outperforms other benchmark methods in experiments.
doi_str_mv 10.1016/j.knosys.2021.107439
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2584777971</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0950705121007012</els_id><sourcerecordid>2584777971</sourcerecordid><originalsourceid>FETCH-LOGICAL-c334t-9888a30dfafb454c0f97755cfb82a5d928a88bd7f1541d19befd45a42ec4bee83</originalsourceid><addsrcrecordid>eNp9kEFvGyEQhVGVSHGc_oMckHJeF1gobA6VKqt1I1nppT4jFmZt3DVsATvKvy_W9tzTaEbvvZn5EHqkZEUJ_fzpuPodYn7PK0YYrSPJ2-4DWlAlWSM56W7QgnSCNJIIeofucz4SQhijaoH8Nlozss0YezM-413I5wnSxWdw-HQei28uHt6wA5jwPpnpgBNMCTKEYoqPAY9gUvBhj998OeDX2kEutfr9oY8Jr2PIJRkfygO6HcyY4eO_ukS7799-rX8025-bl_XXbWPblpemU0qZlrjBDD0X3JKhk1IIO_SKGeE6poxSvZMDFZw62vUwOC4MZ2B5D6DaJXqac6cU_5zrMfoYzynUlZoJxaWUnaRVxWeVTTHnBIOekj-Z9K4p0Veo-qhnqPoKVc9Qq-3LbIP6QSWTdLYeggXnE9iiXfT_D_gLELyEuQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2584777971</pqid></control><display><type>article</type><title>Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint</title><source>Elsevier ScienceDirect Journals</source><creator>Zhang, Xiaobo ; Yang, Yan ; Zhai, Donghai ; Li, Tianrui ; Chu, Jielei ; Wang, Hao</creator><creatorcontrib>Zhang, Xiaobo ; Yang, Yan ; Zhai, Donghai ; Li, Tianrui ; Chu, Jielei ; Wang, Hao</creatorcontrib><description>Multi-view feature fusion is a vital phase for multi-view representation learning. Recently, most Graph Auto-Encoders (GAEs) and their variants focus on multi-view learning. However, most of them ignore deep representation fusion of features of each multi-view. Furthermore, there are scarcely unsupervised constraints guiding to enhance the graph representation capability in training process. In this paper, we propose a novel unsupervised Multi-view Deep Graph Representation Learning (MDGRL) framework on multi-view data which is based on the Graph Auto-Encoders (GAEs) for local feature leaning, a feature fusion module for producing global representation and a valid variant of Variational Graph Auto-Encoder (VGAE) for global deep graph representation learning. To fuse Nearest Neighbor Constraint (NNC) between the maximal degree nodes which represents the most close joining node and their adjacent nodes into VGAE, we propose a new Nearest Neighbor Constraint Variational Graph Auto-Encoder (NNC-VGAE) to enhance the global deep graph representation capability for multi-view data. In the training process of NNC-VGAE, NNC makes the adjacent nodes gradually close to the maximal degree node. Hence, the proposed MDGRL has excellent deep graph representation capability for multi-view data. Experiments on eight non-medical benchmark multi-view data sets and four medical data sets confirm the effectiveness of our MDGRL compared with other state-of-the-art methods for unsupervised clustering. •Fusing all features of single-view graph into a multi-view global graph feature.•Providing a new Nearest Neighbor Constraint Variational Graph Auto-Encoder.•Proposing a Mutli-view Deep Graph Representation Learning (MDGRL) framework.•Proving that MDGRL framework outperforms other benchmark methods in experiments.</description><identifier>ISSN: 0950-7051</identifier><identifier>EISSN: 1872-7409</identifier><identifier>DOI: 10.1016/j.knosys.2021.107439</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Clustering ; Coders ; Datasets ; Deep graph representation learning ; Graph representations ; Graphical representations ; Learning ; Multi-view ; Nearest Neighbor Constraint (NNC) ; Nodes ; Training ; Variational Graph Auto-Encoder (VGAE)</subject><ispartof>Knowledge-based systems, 2021-11, Vol.231, p.107439, Article 107439</ispartof><rights>2021 Elsevier B.V.</rights><rights>Copyright Elsevier Science Ltd. Nov 14, 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c334t-9888a30dfafb454c0f97755cfb82a5d928a88bd7f1541d19befd45a42ec4bee83</citedby><cites>FETCH-LOGICAL-c334t-9888a30dfafb454c0f97755cfb82a5d928a88bd7f1541d19befd45a42ec4bee83</cites><orcidid>0000-0002-6134-6094 ; 0000-0001-8396-5710 ; 0000-0001-6232-5095 ; 0000-0002-6598-0519</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0950705121007012$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids></links><search><creatorcontrib>Zhang, Xiaobo</creatorcontrib><creatorcontrib>Yang, Yan</creatorcontrib><creatorcontrib>Zhai, Donghai</creatorcontrib><creatorcontrib>Li, Tianrui</creatorcontrib><creatorcontrib>Chu, Jielei</creatorcontrib><creatorcontrib>Wang, Hao</creatorcontrib><title>Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint</title><title>Knowledge-based systems</title><description>Multi-view feature fusion is a vital phase for multi-view representation learning. Recently, most Graph Auto-Encoders (GAEs) and their variants focus on multi-view learning. However, most of them ignore deep representation fusion of features of each multi-view. Furthermore, there are scarcely unsupervised constraints guiding to enhance the graph representation capability in training process. In this paper, we propose a novel unsupervised Multi-view Deep Graph Representation Learning (MDGRL) framework on multi-view data which is based on the Graph Auto-Encoders (GAEs) for local feature leaning, a feature fusion module for producing global representation and a valid variant of Variational Graph Auto-Encoder (VGAE) for global deep graph representation learning. To fuse Nearest Neighbor Constraint (NNC) between the maximal degree nodes which represents the most close joining node and their adjacent nodes into VGAE, we propose a new Nearest Neighbor Constraint Variational Graph Auto-Encoder (NNC-VGAE) to enhance the global deep graph representation capability for multi-view data. In the training process of NNC-VGAE, NNC makes the adjacent nodes gradually close to the maximal degree node. Hence, the proposed MDGRL has excellent deep graph representation capability for multi-view data. Experiments on eight non-medical benchmark multi-view data sets and four medical data sets confirm the effectiveness of our MDGRL compared with other state-of-the-art methods for unsupervised clustering. •Fusing all features of single-view graph into a multi-view global graph feature.•Providing a new Nearest Neighbor Constraint Variational Graph Auto-Encoder.•Proposing a Mutli-view Deep Graph Representation Learning (MDGRL) framework.•Proving that MDGRL framework outperforms other benchmark methods in experiments.</description><subject>Clustering</subject><subject>Coders</subject><subject>Datasets</subject><subject>Deep graph representation learning</subject><subject>Graph representations</subject><subject>Graphical representations</subject><subject>Learning</subject><subject>Multi-view</subject><subject>Nearest Neighbor Constraint (NNC)</subject><subject>Nodes</subject><subject>Training</subject><subject>Variational Graph Auto-Encoder (VGAE)</subject><issn>0950-7051</issn><issn>1872-7409</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNp9kEFvGyEQhVGVSHGc_oMckHJeF1gobA6VKqt1I1nppT4jFmZt3DVsATvKvy_W9tzTaEbvvZn5EHqkZEUJ_fzpuPodYn7PK0YYrSPJ2-4DWlAlWSM56W7QgnSCNJIIeofucz4SQhijaoH8Nlozss0YezM-413I5wnSxWdw-HQei28uHt6wA5jwPpnpgBNMCTKEYoqPAY9gUvBhj998OeDX2kEutfr9oY8Jr2PIJRkfygO6HcyY4eO_ukS7799-rX8025-bl_XXbWPblpemU0qZlrjBDD0X3JKhk1IIO_SKGeE6poxSvZMDFZw62vUwOC4MZ2B5D6DaJXqac6cU_5zrMfoYzynUlZoJxaWUnaRVxWeVTTHnBIOekj-Z9K4p0Veo-qhnqPoKVc9Qq-3LbIP6QSWTdLYeggXnE9iiXfT_D_gLELyEuQ</recordid><startdate>20211114</startdate><enddate>20211114</enddate><creator>Zhang, Xiaobo</creator><creator>Yang, Yan</creator><creator>Zhai, Donghai</creator><creator>Li, Tianrui</creator><creator>Chu, Jielei</creator><creator>Wang, Hao</creator><general>Elsevier B.V</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>E3H</scope><scope>F2A</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-6134-6094</orcidid><orcidid>https://orcid.org/0000-0001-8396-5710</orcidid><orcidid>https://orcid.org/0000-0001-6232-5095</orcidid><orcidid>https://orcid.org/0000-0002-6598-0519</orcidid></search><sort><creationdate>20211114</creationdate><title>Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint</title><author>Zhang, Xiaobo ; Yang, Yan ; Zhai, Donghai ; Li, Tianrui ; Chu, Jielei ; Wang, Hao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c334t-9888a30dfafb454c0f97755cfb82a5d928a88bd7f1541d19befd45a42ec4bee83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Clustering</topic><topic>Coders</topic><topic>Datasets</topic><topic>Deep graph representation learning</topic><topic>Graph representations</topic><topic>Graphical representations</topic><topic>Learning</topic><topic>Multi-view</topic><topic>Nearest Neighbor Constraint (NNC)</topic><topic>Nodes</topic><topic>Training</topic><topic>Variational Graph Auto-Encoder (VGAE)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Xiaobo</creatorcontrib><creatorcontrib>Yang, Yan</creatorcontrib><creatorcontrib>Zhai, Donghai</creatorcontrib><creatorcontrib>Li, Tianrui</creatorcontrib><creatorcontrib>Chu, Jielei</creatorcontrib><creatorcontrib>Wang, Hao</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>Library &amp; Information Sciences Abstracts (LISA)</collection><collection>Library &amp; Information Science Abstracts (LISA)</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Knowledge-based systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Xiaobo</au><au>Yang, Yan</au><au>Zhai, Donghai</au><au>Li, Tianrui</au><au>Chu, Jielei</au><au>Wang, Hao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint</atitle><jtitle>Knowledge-based systems</jtitle><date>2021-11-14</date><risdate>2021</risdate><volume>231</volume><spage>107439</spage><pages>107439-</pages><artnum>107439</artnum><issn>0950-7051</issn><eissn>1872-7409</eissn><abstract>Multi-view feature fusion is a vital phase for multi-view representation learning. Recently, most Graph Auto-Encoders (GAEs) and their variants focus on multi-view learning. However, most of them ignore deep representation fusion of features of each multi-view. Furthermore, there are scarcely unsupervised constraints guiding to enhance the graph representation capability in training process. In this paper, we propose a novel unsupervised Multi-view Deep Graph Representation Learning (MDGRL) framework on multi-view data which is based on the Graph Auto-Encoders (GAEs) for local feature leaning, a feature fusion module for producing global representation and a valid variant of Variational Graph Auto-Encoder (VGAE) for global deep graph representation learning. To fuse Nearest Neighbor Constraint (NNC) between the maximal degree nodes which represents the most close joining node and their adjacent nodes into VGAE, we propose a new Nearest Neighbor Constraint Variational Graph Auto-Encoder (NNC-VGAE) to enhance the global deep graph representation capability for multi-view data. In the training process of NNC-VGAE, NNC makes the adjacent nodes gradually close to the maximal degree node. Hence, the proposed MDGRL has excellent deep graph representation capability for multi-view data. Experiments on eight non-medical benchmark multi-view data sets and four medical data sets confirm the effectiveness of our MDGRL compared with other state-of-the-art methods for unsupervised clustering. •Fusing all features of single-view graph into a multi-view global graph feature.•Providing a new Nearest Neighbor Constraint Variational Graph Auto-Encoder.•Proposing a Mutli-view Deep Graph Representation Learning (MDGRL) framework.•Proving that MDGRL framework outperforms other benchmark methods in experiments.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.knosys.2021.107439</doi><orcidid>https://orcid.org/0000-0002-6134-6094</orcidid><orcidid>https://orcid.org/0000-0001-8396-5710</orcidid><orcidid>https://orcid.org/0000-0001-6232-5095</orcidid><orcidid>https://orcid.org/0000-0002-6598-0519</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0950-7051
ispartof Knowledge-based systems, 2021-11, Vol.231, p.107439, Article 107439
issn 0950-7051
1872-7409
language eng
recordid cdi_proquest_journals_2584777971
source Elsevier ScienceDirect Journals
subjects Clustering
Coders
Datasets
Deep graph representation learning
Graph representations
Graphical representations
Learning
Multi-view
Nearest Neighbor Constraint (NNC)
Nodes
Training
Variational Graph Auto-Encoder (VGAE)
title Local2Global: Unsupervised multi-view deep graph representation learning with Nearest Neighbor Constraint
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T08%3A06%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Local2Global:%20Unsupervised%20multi-view%20deep%20graph%20representation%20learning%20with%20Nearest%20Neighbor%20Constraint&rft.jtitle=Knowledge-based%20systems&rft.au=Zhang,%20Xiaobo&rft.date=2021-11-14&rft.volume=231&rft.spage=107439&rft.pages=107439-&rft.artnum=107439&rft.issn=0950-7051&rft.eissn=1872-7409&rft_id=info:doi/10.1016/j.knosys.2021.107439&rft_dat=%3Cproquest_cross%3E2584777971%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2584777971&rft_id=info:pmid/&rft_els_id=S0950705121007012&rfr_iscdi=true