Node Duplication Improves Cold-start Link Prediction
Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical appli...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Guo, Zhichun Zhao, Tong Liu, Yozen Dong, Kaiwen Shiao, William Shah, Neil Chawla, Nitesh V |
description | Graph Neural Networks (GNNs) are prominent in graph machine learning and have
shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless,
recent studies show that GNNs struggle to produce good results on low-degree
nodes despite their overall strong performance. In practical applications of
LP, like recommendation systems, improving performance on low-degree nodes is
critical, as it amounts to tackling the cold-start problem of improving the
experiences of users with few observed interactions. In this paper, we
investigate improving GNNs' LP performance on low-degree nodes while preserving
their performance on high-degree nodes and propose a simple yet surprisingly
effective augmentation technique called NodeDup. Specifically, NodeDup
duplicates low-degree nodes and creates links between nodes and their own
duplicates before following the standard supervised LP training scheme. By
leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows
significant LP performance improvements on low-degree nodes without
compromising any performance on high-degree nodes. Additionally, as a
plug-and-play augmentation module, NodeDup can be easily applied to existing
GNNs with very light computational cost. Extensive experiments show that
NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated,
low-degree, and warm nodes, respectively, on average across all datasets
compared to GNNs and state-of-the-art cold-start methods. |
doi_str_mv | 10.48550/arxiv.2402.09711 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2402_09711</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2402_09711</sourcerecordid><originalsourceid>FETCH-LOGICAL-a671-1a8a28ef80b1571807956319f5033393475749d16da50ae74b40cfc561de13993</originalsourceid><addsrcrecordid>eNotzrFuwjAUhWEvDAj6AEz4BZLeG9uxPaJAW6QIGNijS-xIFoFETorg7RG001l-HX2MLRBSaZSCT4r3cEszCVkKViNOmdx1zvP1b9-GmsbQXfn20sfu5gdedK1LhpHiyMtwPfND9C7Ur2bOJg21g__43xk7fm2OxU9S7r-3xapMKNeYIBnKjG8MnFBpNKCtygXaRoEQwgqplZbWYe5IAXktTxLqplY5Oo_CWjFjy7_bN7vqY7hQfFQvfvXmiyfjOD3c</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Node Duplication Improves Cold-start Link Prediction</title><source>arXiv.org</source><creator>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</creator><creatorcontrib>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</creatorcontrib><description>Graph Neural Networks (GNNs) are prominent in graph machine learning and have
shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless,
recent studies show that GNNs struggle to produce good results on low-degree
nodes despite their overall strong performance. In practical applications of
LP, like recommendation systems, improving performance on low-degree nodes is
critical, as it amounts to tackling the cold-start problem of improving the
experiences of users with few observed interactions. In this paper, we
investigate improving GNNs' LP performance on low-degree nodes while preserving
their performance on high-degree nodes and propose a simple yet surprisingly
effective augmentation technique called NodeDup. Specifically, NodeDup
duplicates low-degree nodes and creates links between nodes and their own
duplicates before following the standard supervised LP training scheme. By
leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows
significant LP performance improvements on low-degree nodes without
compromising any performance on high-degree nodes. Additionally, as a
plug-and-play augmentation module, NodeDup can be easily applied to existing
GNNs with very light computational cost. Extensive experiments show that
NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated,
low-degree, and warm nodes, respectively, on average across all datasets
compared to GNNs and state-of-the-art cold-start methods.</description><identifier>DOI: 10.48550/arxiv.2402.09711</identifier><language>eng</language><subject>Computer Science - Learning ; Computer Science - Social and Information Networks</subject><creationdate>2024-02</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2402.09711$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2402.09711$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Guo, Zhichun</creatorcontrib><creatorcontrib>Zhao, Tong</creatorcontrib><creatorcontrib>Liu, Yozen</creatorcontrib><creatorcontrib>Dong, Kaiwen</creatorcontrib><creatorcontrib>Shiao, William</creatorcontrib><creatorcontrib>Shah, Neil</creatorcontrib><creatorcontrib>Chawla, Nitesh V</creatorcontrib><title>Node Duplication Improves Cold-start Link Prediction</title><description>Graph Neural Networks (GNNs) are prominent in graph machine learning and have
shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless,
recent studies show that GNNs struggle to produce good results on low-degree
nodes despite their overall strong performance. In practical applications of
LP, like recommendation systems, improving performance on low-degree nodes is
critical, as it amounts to tackling the cold-start problem of improving the
experiences of users with few observed interactions. In this paper, we
investigate improving GNNs' LP performance on low-degree nodes while preserving
their performance on high-degree nodes and propose a simple yet surprisingly
effective augmentation technique called NodeDup. Specifically, NodeDup
duplicates low-degree nodes and creates links between nodes and their own
duplicates before following the standard supervised LP training scheme. By
leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows
significant LP performance improvements on low-degree nodes without
compromising any performance on high-degree nodes. Additionally, as a
plug-and-play augmentation module, NodeDup can be easily applied to existing
GNNs with very light computational cost. Extensive experiments show that
NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated,
low-degree, and warm nodes, respectively, on average across all datasets
compared to GNNs and state-of-the-art cold-start methods.</description><subject>Computer Science - Learning</subject><subject>Computer Science - Social and Information Networks</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrFuwjAUhWEvDAj6AEz4BZLeG9uxPaJAW6QIGNijS-xIFoFETorg7RG001l-HX2MLRBSaZSCT4r3cEszCVkKViNOmdx1zvP1b9-GmsbQXfn20sfu5gdedK1LhpHiyMtwPfND9C7Ur2bOJg21g__43xk7fm2OxU9S7r-3xapMKNeYIBnKjG8MnFBpNKCtygXaRoEQwgqplZbWYe5IAXktTxLqplY5Oo_CWjFjy7_bN7vqY7hQfFQvfvXmiyfjOD3c</recordid><startdate>20240215</startdate><enddate>20240215</enddate><creator>Guo, Zhichun</creator><creator>Zhao, Tong</creator><creator>Liu, Yozen</creator><creator>Dong, Kaiwen</creator><creator>Shiao, William</creator><creator>Shah, Neil</creator><creator>Chawla, Nitesh V</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240215</creationdate><title>Node Duplication Improves Cold-start Link Prediction</title><author>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a671-1a8a28ef80b1571807956319f5033393475749d16da50ae74b40cfc561de13993</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Learning</topic><topic>Computer Science - Social and Information Networks</topic><toplevel>online_resources</toplevel><creatorcontrib>Guo, Zhichun</creatorcontrib><creatorcontrib>Zhao, Tong</creatorcontrib><creatorcontrib>Liu, Yozen</creatorcontrib><creatorcontrib>Dong, Kaiwen</creatorcontrib><creatorcontrib>Shiao, William</creatorcontrib><creatorcontrib>Shah, Neil</creatorcontrib><creatorcontrib>Chawla, Nitesh V</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Guo, Zhichun</au><au>Zhao, Tong</au><au>Liu, Yozen</au><au>Dong, Kaiwen</au><au>Shiao, William</au><au>Shah, Neil</au><au>Chawla, Nitesh V</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Node Duplication Improves Cold-start Link Prediction</atitle><date>2024-02-15</date><risdate>2024</risdate><abstract>Graph Neural Networks (GNNs) are prominent in graph machine learning and have
shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless,
recent studies show that GNNs struggle to produce good results on low-degree
nodes despite their overall strong performance. In practical applications of
LP, like recommendation systems, improving performance on low-degree nodes is
critical, as it amounts to tackling the cold-start problem of improving the
experiences of users with few observed interactions. In this paper, we
investigate improving GNNs' LP performance on low-degree nodes while preserving
their performance on high-degree nodes and propose a simple yet surprisingly
effective augmentation technique called NodeDup. Specifically, NodeDup
duplicates low-degree nodes and creates links between nodes and their own
duplicates before following the standard supervised LP training scheme. By
leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows
significant LP performance improvements on low-degree nodes without
compromising any performance on high-degree nodes. Additionally, as a
plug-and-play augmentation module, NodeDup can be easily applied to existing
GNNs with very light computational cost. Extensive experiments show that
NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated,
low-degree, and warm nodes, respectively, on average across all datasets
compared to GNNs and state-of-the-art cold-start methods.</abstract><doi>10.48550/arxiv.2402.09711</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2402.09711 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2402_09711 |
source | arXiv.org |
subjects | Computer Science - Learning Computer Science - Social and Information Networks |
title | Node Duplication Improves Cold-start Link Prediction |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T18%3A20%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Node%20Duplication%20Improves%20Cold-start%20Link%20Prediction&rft.au=Guo,%20Zhichun&rft.date=2024-02-15&rft_id=info:doi/10.48550/arxiv.2402.09711&rft_dat=%3Carxiv_GOX%3E2402_09711%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |