Simple and Asymmetric Graph Contrastive Learning without Augmentations
Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily assumptions. Thus, they fail to generalize well to heterophilic graphs where co...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Graph Contrastive Learning (GCL) has shown superior performance in
representation learning in graph-structured data. Despite their success, most
existing GCL methods rely on prefabricated graph augmentation and homophily
assumptions. Thus, they fail to generalize well to heterophilic graphs where
connected nodes may have different class labels and dissimilar features. In
this paper, we study the problem of conducting contrastive learning on
homophilic and heterophilic graphs. We find that we can achieve promising
performance simply by considering an asymmetric view of the neighboring nodes.
The resulting simple algorithm, Asymmetric Contrastive Learning for Graphs
(GraphACL), is easy to implement and does not rely on graph augmentations and
homophily assumptions. We provide theoretical and empirical evidence that
GraphACL can capture one-hop local neighborhood information and two-hop
monophily similarity, which are both important for modeling heterophilic
graphs. Experimental results show that the simple GraphACL significantly
outperforms state-of-the-art graph contrastive learning and self-supervised
learning methods on homophilic and heterophilic graphs. The code of GraphACL is
available at https://github.com/tengxiao1/GraphACL. |
---|---|
DOI: | 10.48550/arxiv.2310.18884 |