Graph Representation Learning via Contrasting Cluster Assignments

With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these m...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on cognitive and developmental systems 2024-06, Vol.16 (3), p.912-922
Hauptverfasser: Zhang, Chun-Yang, Yao, Hong-Yu, Chen, C. L. Philip, Lin, Yue-Na
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 922
container_issue 3
container_start_page 912
container_title IEEE transactions on cognitive and developmental systems
container_volume 16
creator Zhang, Chun-Yang
Yao, Hong-Yu
Chen, C. L. Philip
Lin, Yue-Na
description With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.
doi_str_mv 10.1109/TCDS.2023.3313206
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_3066955040</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10243574</ieee_id><sourcerecordid>3066955040</sourcerecordid><originalsourceid>FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</originalsourceid><addsrcrecordid>eNpNkE1Lw0AQhhdRsGh_gOAh4Dl1vz-OJWoVCoLW87JJZ2tKu4m7W8F_b0KLeJp34Hln4EHohuAZIdjcr6qH9xnFlM0YI4xieYYmlClTasPM-V-m-BJNU9pijIlkSnM1QfNFdP1n8QZ9hAQhu9x2oViCi6ENm-K7dUXVhRxdyuNe7Q4pQyzmKbWbsB8K6RpdeLdLMD3NK_Tx9Liqnsvl6-Klmi_LhnKZS8eMVuA4cOVrxVVNNAUtZSMaDuAV835dC6qFZ7XkBiupJF-vNeeGg9GCXaG7490-dl8HSNluu0MMw0vLsJRGCMzxQJEj1cQupQje9rHdu_hjCbajLDvKsqMse5I1dG6PnRYA_vGUM6E4-wXGd2UQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3066955040</pqid></control><display><type>article</type><title>Graph Representation Learning via Contrasting Cluster Assignments</title><source>IEEE Electronic Library (IEL)</source><creator>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</creator><creatorcontrib>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</creatorcontrib><description>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</description><identifier>ISSN: 2379-8920</identifier><identifier>EISSN: 2379-8939</identifier><identifier>DOI: 10.1109/TCDS.2023.3313206</identifier><identifier>CODEN: ITCDA4</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Clustering ; Clustering algorithms ; Clusters ; Contrastive learning ; graph data mining ; graph representation learning (GRL) ; Graph representations ; Graphical representations ; Machine learning ; Nodes ; Prototypes ; Representation learning ; Social networking (online) ; Task analysis ; Topology ; Unsupervised learning</subject><ispartof>IEEE transactions on cognitive and developmental systems, 2024-06, Vol.16 (3), p.912-922</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</cites><orcidid>0000-0001-5451-7230 ; 0000-0001-6151-7028 ; 0000-0002-2397-0793 ; 0000-0001-8126-0733</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10243574$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10243574$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhang, Chun-Yang</creatorcontrib><creatorcontrib>Yao, Hong-Yu</creatorcontrib><creatorcontrib>Chen, C. L. Philip</creatorcontrib><creatorcontrib>Lin, Yue-Na</creatorcontrib><title>Graph Representation Learning via Contrasting Cluster Assignments</title><title>IEEE transactions on cognitive and developmental systems</title><addtitle>TCDS</addtitle><description>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</description><subject>Algorithms</subject><subject>Clustering</subject><subject>Clustering algorithms</subject><subject>Clusters</subject><subject>Contrastive learning</subject><subject>graph data mining</subject><subject>graph representation learning (GRL)</subject><subject>Graph representations</subject><subject>Graphical representations</subject><subject>Machine learning</subject><subject>Nodes</subject><subject>Prototypes</subject><subject>Representation learning</subject><subject>Social networking (online)</subject><subject>Task analysis</subject><subject>Topology</subject><subject>Unsupervised learning</subject><issn>2379-8920</issn><issn>2379-8939</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkE1Lw0AQhhdRsGh_gOAh4Dl1vz-OJWoVCoLW87JJZ2tKu4m7W8F_b0KLeJp34Hln4EHohuAZIdjcr6qH9xnFlM0YI4xieYYmlClTasPM-V-m-BJNU9pijIlkSnM1QfNFdP1n8QZ9hAQhu9x2oViCi6ENm-K7dUXVhRxdyuNe7Q4pQyzmKbWbsB8K6RpdeLdLMD3NK_Tx9Liqnsvl6-Klmi_LhnKZS8eMVuA4cOVrxVVNNAUtZSMaDuAV835dC6qFZ7XkBiupJF-vNeeGg9GCXaG7490-dl8HSNluu0MMw0vLsJRGCMzxQJEj1cQupQje9rHdu_hjCbajLDvKsqMse5I1dG6PnRYA_vGUM6E4-wXGd2UQ</recordid><startdate>20240601</startdate><enddate>20240601</enddate><creator>Zhang, Chun-Yang</creator><creator>Yao, Hong-Yu</creator><creator>Chen, C. L. Philip</creator><creator>Lin, Yue-Na</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5451-7230</orcidid><orcidid>https://orcid.org/0000-0001-6151-7028</orcidid><orcidid>https://orcid.org/0000-0002-2397-0793</orcidid><orcidid>https://orcid.org/0000-0001-8126-0733</orcidid></search><sort><creationdate>20240601</creationdate><title>Graph Representation Learning via Contrasting Cluster Assignments</title><author>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Algorithms</topic><topic>Clustering</topic><topic>Clustering algorithms</topic><topic>Clusters</topic><topic>Contrastive learning</topic><topic>graph data mining</topic><topic>graph representation learning (GRL)</topic><topic>Graph representations</topic><topic>Graphical representations</topic><topic>Machine learning</topic><topic>Nodes</topic><topic>Prototypes</topic><topic>Representation learning</topic><topic>Social networking (online)</topic><topic>Task analysis</topic><topic>Topology</topic><topic>Unsupervised learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Chun-Yang</creatorcontrib><creatorcontrib>Yao, Hong-Yu</creatorcontrib><creatorcontrib>Chen, C. L. Philip</creatorcontrib><creatorcontrib>Lin, Yue-Na</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on cognitive and developmental systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhang, Chun-Yang</au><au>Yao, Hong-Yu</au><au>Chen, C. L. Philip</au><au>Lin, Yue-Na</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Graph Representation Learning via Contrasting Cluster Assignments</atitle><jtitle>IEEE transactions on cognitive and developmental systems</jtitle><stitle>TCDS</stitle><date>2024-06-01</date><risdate>2024</risdate><volume>16</volume><issue>3</issue><spage>912</spage><epage>922</epage><pages>912-922</pages><issn>2379-8920</issn><eissn>2379-8939</eissn><coden>ITCDA4</coden><abstract>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TCDS.2023.3313206</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0001-5451-7230</orcidid><orcidid>https://orcid.org/0000-0001-6151-7028</orcidid><orcidid>https://orcid.org/0000-0002-2397-0793</orcidid><orcidid>https://orcid.org/0000-0001-8126-0733</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2379-8920
ispartof IEEE transactions on cognitive and developmental systems, 2024-06, Vol.16 (3), p.912-922
issn 2379-8920
2379-8939
language eng
recordid cdi_proquest_journals_3066955040
source IEEE Electronic Library (IEL)
subjects Algorithms
Clustering
Clustering algorithms
Clusters
Contrastive learning
graph data mining
graph representation learning (GRL)
Graph representations
Graphical representations
Machine learning
Nodes
Prototypes
Representation learning
Social networking (online)
Task analysis
Topology
Unsupervised learning
title Graph Representation Learning via Contrasting Cluster Assignments
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T03%3A22%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Graph%20Representation%20Learning%20via%20Contrasting%20Cluster%20Assignments&rft.jtitle=IEEE%20transactions%20on%20cognitive%20and%20developmental%20systems&rft.au=Zhang,%20Chun-Yang&rft.date=2024-06-01&rft.volume=16&rft.issue=3&rft.spage=912&rft.epage=922&rft.pages=912-922&rft.issn=2379-8920&rft.eissn=2379-8939&rft.coden=ITCDA4&rft_id=info:doi/10.1109/TCDS.2023.3313206&rft_dat=%3Cproquest_RIE%3E3066955040%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3066955040&rft_id=info:pmid/&rft_ieee_id=10243574&rfr_iscdi=true