Graph Representation Learning via Contrasting Cluster Assignments
With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these m...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on cognitive and developmental systems 2024-06, Vol.16 (3), p.912-922 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 922 |
---|---|
container_issue | 3 |
container_start_page | 912 |
container_title | IEEE transactions on cognitive and developmental systems |
container_volume | 16 |
creator | Zhang, Chun-Yang Yao, Hong-Yu Chen, C. L. Philip Lin, Yue-Na |
description | With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks. |
doi_str_mv | 10.1109/TCDS.2023.3313206 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_3066955040</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10243574</ieee_id><sourcerecordid>3066955040</sourcerecordid><originalsourceid>FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</originalsourceid><addsrcrecordid>eNpNkE1Lw0AQhhdRsGh_gOAh4Dl1vz-OJWoVCoLW87JJZ2tKu4m7W8F_b0KLeJp34Hln4EHohuAZIdjcr6qH9xnFlM0YI4xieYYmlClTasPM-V-m-BJNU9pijIlkSnM1QfNFdP1n8QZ9hAQhu9x2oViCi6ENm-K7dUXVhRxdyuNe7Q4pQyzmKbWbsB8K6RpdeLdLMD3NK_Tx9Liqnsvl6-Klmi_LhnKZS8eMVuA4cOVrxVVNNAUtZSMaDuAV835dC6qFZ7XkBiupJF-vNeeGg9GCXaG7490-dl8HSNluu0MMw0vLsJRGCMzxQJEj1cQupQje9rHdu_hjCbajLDvKsqMse5I1dG6PnRYA_vGUM6E4-wXGd2UQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3066955040</pqid></control><display><type>article</type><title>Graph Representation Learning via Contrasting Cluster Assignments</title><source>IEEE Electronic Library (IEL)</source><creator>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</creator><creatorcontrib>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</creatorcontrib><description>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</description><identifier>ISSN: 2379-8920</identifier><identifier>EISSN: 2379-8939</identifier><identifier>DOI: 10.1109/TCDS.2023.3313206</identifier><identifier>CODEN: ITCDA4</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Clustering ; Clustering algorithms ; Clusters ; Contrastive learning ; graph data mining ; graph representation learning (GRL) ; Graph representations ; Graphical representations ; Machine learning ; Nodes ; Prototypes ; Representation learning ; Social networking (online) ; Task analysis ; Topology ; Unsupervised learning</subject><ispartof>IEEE transactions on cognitive and developmental systems, 2024-06, Vol.16 (3), p.912-922</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</cites><orcidid>0000-0001-5451-7230 ; 0000-0001-6151-7028 ; 0000-0002-2397-0793 ; 0000-0001-8126-0733</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10243574$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10243574$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhang, Chun-Yang</creatorcontrib><creatorcontrib>Yao, Hong-Yu</creatorcontrib><creatorcontrib>Chen, C. L. Philip</creatorcontrib><creatorcontrib>Lin, Yue-Na</creatorcontrib><title>Graph Representation Learning via Contrasting Cluster Assignments</title><title>IEEE transactions on cognitive and developmental systems</title><addtitle>TCDS</addtitle><description>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</description><subject>Algorithms</subject><subject>Clustering</subject><subject>Clustering algorithms</subject><subject>Clusters</subject><subject>Contrastive learning</subject><subject>graph data mining</subject><subject>graph representation learning (GRL)</subject><subject>Graph representations</subject><subject>Graphical representations</subject><subject>Machine learning</subject><subject>Nodes</subject><subject>Prototypes</subject><subject>Representation learning</subject><subject>Social networking (online)</subject><subject>Task analysis</subject><subject>Topology</subject><subject>Unsupervised learning</subject><issn>2379-8920</issn><issn>2379-8939</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkE1Lw0AQhhdRsGh_gOAh4Dl1vz-OJWoVCoLW87JJZ2tKu4m7W8F_b0KLeJp34Hln4EHohuAZIdjcr6qH9xnFlM0YI4xieYYmlClTasPM-V-m-BJNU9pijIlkSnM1QfNFdP1n8QZ9hAQhu9x2oViCi6ENm-K7dUXVhRxdyuNe7Q4pQyzmKbWbsB8K6RpdeLdLMD3NK_Tx9Liqnsvl6-Klmi_LhnKZS8eMVuA4cOVrxVVNNAUtZSMaDuAV835dC6qFZ7XkBiupJF-vNeeGg9GCXaG7490-dl8HSNluu0MMw0vLsJRGCMzxQJEj1cQupQje9rHdu_hjCbajLDvKsqMse5I1dG6PnRYA_vGUM6E4-wXGd2UQ</recordid><startdate>20240601</startdate><enddate>20240601</enddate><creator>Zhang, Chun-Yang</creator><creator>Yao, Hong-Yu</creator><creator>Chen, C. L. Philip</creator><creator>Lin, Yue-Na</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5451-7230</orcidid><orcidid>https://orcid.org/0000-0001-6151-7028</orcidid><orcidid>https://orcid.org/0000-0002-2397-0793</orcidid><orcidid>https://orcid.org/0000-0001-8126-0733</orcidid></search><sort><creationdate>20240601</creationdate><title>Graph Representation Learning via Contrasting Cluster Assignments</title><author>Zhang, Chun-Yang ; Yao, Hong-Yu ; Chen, C. L. Philip ; Lin, Yue-Na</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c246t-a3987ea4e47fb747b182e866c5c4eef73ffdb5285f3b649076764dd84494e9853</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Algorithms</topic><topic>Clustering</topic><topic>Clustering algorithms</topic><topic>Clusters</topic><topic>Contrastive learning</topic><topic>graph data mining</topic><topic>graph representation learning (GRL)</topic><topic>Graph representations</topic><topic>Graphical representations</topic><topic>Machine learning</topic><topic>Nodes</topic><topic>Prototypes</topic><topic>Representation learning</topic><topic>Social networking (online)</topic><topic>Task analysis</topic><topic>Topology</topic><topic>Unsupervised learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Chun-Yang</creatorcontrib><creatorcontrib>Yao, Hong-Yu</creatorcontrib><creatorcontrib>Chen, C. L. Philip</creatorcontrib><creatorcontrib>Lin, Yue-Na</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on cognitive and developmental systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhang, Chun-Yang</au><au>Yao, Hong-Yu</au><au>Chen, C. L. Philip</au><au>Lin, Yue-Na</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Graph Representation Learning via Contrasting Cluster Assignments</atitle><jtitle>IEEE transactions on cognitive and developmental systems</jtitle><stitle>TCDS</stitle><date>2024-06-01</date><risdate>2024</risdate><volume>16</volume><issue>3</issue><spage>912</spage><epage>922</epage><pages>912-922</pages><issn>2379-8920</issn><eissn>2379-8939</eissn><coden>ITCDA4</coden><abstract>With the rise of contrastive learning, unsupervised graph representation learning (GRL) has shown strong competitiveness. However, existing graph contrastive models typically either focus on the local view of graphs or take simple considerations of both global and local views. This may cause these models to overemphasize the importance of individual nodes and their ego networks, or to result in poor learning of global knowledge and affect the learning of local views. Additionally, most GRL models pay attention to topological proximity, assuming that nodes that are closer in graph topology are more similar. However, in the real world, close nodes may be dissimilar, which makes the learned embeddings incorporate inappropriate messages and thus lack discrimination. To address these issues, we propose a novel unsupervised GRL model by contrasting cluster assignments, called graph representation learning model via contrasting cluster assignment (GRCCA). To comprehensively explore the global and local views, it combines multiview contrastive learning and clustering algorithms with an opposite augmentation strategy. It leverages clustering algorithms to capture fine-grained global information and explore potential relevance between nodes in different augmented perspectives while preserving high-quality global and local information through contrast between nodes and prototypes. The opposite augmentation strategy further enhances the contrast of both views, allowing the model to excavate more invariant features. Experimental results show that GRCCA has strong competitiveness compared to state-of-the-art models in different graph analysis tasks.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TCDS.2023.3313206</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0001-5451-7230</orcidid><orcidid>https://orcid.org/0000-0001-6151-7028</orcidid><orcidid>https://orcid.org/0000-0002-2397-0793</orcidid><orcidid>https://orcid.org/0000-0001-8126-0733</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2379-8920 |
ispartof | IEEE transactions on cognitive and developmental systems, 2024-06, Vol.16 (3), p.912-922 |
issn | 2379-8920 2379-8939 |
language | eng |
recordid | cdi_proquest_journals_3066955040 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithms Clustering Clustering algorithms Clusters Contrastive learning graph data mining graph representation learning (GRL) Graph representations Graphical representations Machine learning Nodes Prototypes Representation learning Social networking (online) Task analysis Topology Unsupervised learning |
title | Graph Representation Learning via Contrasting Cluster Assignments |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T03%3A22%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Graph%20Representation%20Learning%20via%20Contrasting%20Cluster%20Assignments&rft.jtitle=IEEE%20transactions%20on%20cognitive%20and%20developmental%20systems&rft.au=Zhang,%20Chun-Yang&rft.date=2024-06-01&rft.volume=16&rft.issue=3&rft.spage=912&rft.epage=922&rft.pages=912-922&rft.issn=2379-8920&rft.eissn=2379-8939&rft.coden=ITCDA4&rft_id=info:doi/10.1109/TCDS.2023.3313206&rft_dat=%3Cproquest_RIE%3E3066955040%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3066955040&rft_id=info:pmid/&rft_ieee_id=10243574&rfr_iscdi=true |