Customizing graph neural networks using path reweighting

Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are not always effective. Intuitively, paths in a graph imply d...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Information sciences 2024-07, Vol.674, p.120681, Article 120681
Hauptverfasser: Chen, Jianpeng, Wang, Yujing, Zeng, Ming, Xiang, Zongyi, Hou, Bitan, Tong, Yunhai, J. Mengshoel, Ole, Ren, Yazhou
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are not always effective. Intuitively, paths in a graph imply different semantics for different downstream tasks. Inspired by this, we design a novel GNN solution, namely Customized Graph Neural Network with Path Reweighting (CustomGNN for short). Specifically, the proposed CustomGNN can automatically learn the high-level semantics for specific downstream tasks to highlight semantically relevant paths as well to filter out task-irrelevant noises in a graph. Furthermore, we empirically analyze the semantics learned by CustomGNN and demonstrate its ability to avoid the three inherent problems in traditional GNNs, i.e., over-smoothing, poor robustness, and overfitting. In experiments with the node classification task, CustomGNN achieves state-of-the-art accuracies on three standard graph datasets and four large graph datasets. The source code of the proposed CustomGNN is available at https://github.com/cjpcool/CustomGNN. •We propose a novel graph neural network architecture named CustomGNN.•CustomGNN incorporates task-oriented semantic features with generic graph features.•Two unsupervised loss functions are proposed to regularize the learning procedure.•The semantics extracted from graph paths are visualized and analyzed.•CustomGNN can mitigate the issues of over-smoothing, non-robustness and overfitting.
ISSN:0020-0255
DOI:10.1016/j.ins.2024.120681