Node Duplication Improves Cold-start Link Prediction

Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical appli...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Guo, Zhichun, Zhao, Tong, Liu, Yozen, Dong, Kaiwen, Shiao, William, Shah, Neil, Chawla, Nitesh V
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Guo, Zhichun
Zhao, Tong
Liu, Yozen
Dong, Kaiwen
Shiao, William
Shah, Neil
Chawla, Nitesh V
description Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.
doi_str_mv 10.48550/arxiv.2402.09711
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2402_09711</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2402_09711</sourcerecordid><originalsourceid>FETCH-LOGICAL-a671-1a8a28ef80b1571807956319f5033393475749d16da50ae74b40cfc561de13993</originalsourceid><addsrcrecordid>eNotzrFuwjAUhWEvDAj6AEz4BZLeG9uxPaJAW6QIGNijS-xIFoFETorg7RG001l-HX2MLRBSaZSCT4r3cEszCVkKViNOmdx1zvP1b9-GmsbQXfn20sfu5gdedK1LhpHiyMtwPfND9C7Ur2bOJg21g__43xk7fm2OxU9S7r-3xapMKNeYIBnKjG8MnFBpNKCtygXaRoEQwgqplZbWYe5IAXktTxLqplY5Oo_CWjFjy7_bN7vqY7hQfFQvfvXmiyfjOD3c</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Node Duplication Improves Cold-start Link Prediction</title><source>arXiv.org</source><creator>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</creator><creatorcontrib>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</creatorcontrib><description>Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.</description><identifier>DOI: 10.48550/arxiv.2402.09711</identifier><language>eng</language><subject>Computer Science - Learning ; Computer Science - Social and Information Networks</subject><creationdate>2024-02</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2402.09711$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2402.09711$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Guo, Zhichun</creatorcontrib><creatorcontrib>Zhao, Tong</creatorcontrib><creatorcontrib>Liu, Yozen</creatorcontrib><creatorcontrib>Dong, Kaiwen</creatorcontrib><creatorcontrib>Shiao, William</creatorcontrib><creatorcontrib>Shah, Neil</creatorcontrib><creatorcontrib>Chawla, Nitesh V</creatorcontrib><title>Node Duplication Improves Cold-start Link Prediction</title><description>Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.</description><subject>Computer Science - Learning</subject><subject>Computer Science - Social and Information Networks</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrFuwjAUhWEvDAj6AEz4BZLeG9uxPaJAW6QIGNijS-xIFoFETorg7RG001l-HX2MLRBSaZSCT4r3cEszCVkKViNOmdx1zvP1b9-GmsbQXfn20sfu5gdedK1LhpHiyMtwPfND9C7Ur2bOJg21g__43xk7fm2OxU9S7r-3xapMKNeYIBnKjG8MnFBpNKCtygXaRoEQwgqplZbWYe5IAXktTxLqplY5Oo_CWjFjy7_bN7vqY7hQfFQvfvXmiyfjOD3c</recordid><startdate>20240215</startdate><enddate>20240215</enddate><creator>Guo, Zhichun</creator><creator>Zhao, Tong</creator><creator>Liu, Yozen</creator><creator>Dong, Kaiwen</creator><creator>Shiao, William</creator><creator>Shah, Neil</creator><creator>Chawla, Nitesh V</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240215</creationdate><title>Node Duplication Improves Cold-start Link Prediction</title><author>Guo, Zhichun ; Zhao, Tong ; Liu, Yozen ; Dong, Kaiwen ; Shiao, William ; Shah, Neil ; Chawla, Nitesh V</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a671-1a8a28ef80b1571807956319f5033393475749d16da50ae74b40cfc561de13993</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Learning</topic><topic>Computer Science - Social and Information Networks</topic><toplevel>online_resources</toplevel><creatorcontrib>Guo, Zhichun</creatorcontrib><creatorcontrib>Zhao, Tong</creatorcontrib><creatorcontrib>Liu, Yozen</creatorcontrib><creatorcontrib>Dong, Kaiwen</creatorcontrib><creatorcontrib>Shiao, William</creatorcontrib><creatorcontrib>Shah, Neil</creatorcontrib><creatorcontrib>Chawla, Nitesh V</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Guo, Zhichun</au><au>Zhao, Tong</au><au>Liu, Yozen</au><au>Dong, Kaiwen</au><au>Shiao, William</au><au>Shah, Neil</au><au>Chawla, Nitesh V</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Node Duplication Improves Cold-start Link Prediction</atitle><date>2024-02-15</date><risdate>2024</risdate><abstract>Graph Neural Networks (GNNs) are prominent in graph machine learning and have shown state-of-the-art performance in Link Prediction (LP) tasks. Nonetheless, recent studies show that GNNs struggle to produce good results on low-degree nodes despite their overall strong performance. In practical applications of LP, like recommendation systems, improving performance on low-degree nodes is critical, as it amounts to tackling the cold-start problem of improving the experiences of users with few observed interactions. In this paper, we investigate improving GNNs' LP performance on low-degree nodes while preserving their performance on high-degree nodes and propose a simple yet surprisingly effective augmentation technique called NodeDup. Specifically, NodeDup duplicates low-degree nodes and creates links between nodes and their own duplicates before following the standard supervised LP training scheme. By leveraging a ''multi-view'' perspective for low-degree nodes, NodeDup shows significant LP performance improvements on low-degree nodes without compromising any performance on high-degree nodes. Additionally, as a plug-and-play augmentation module, NodeDup can be easily applied to existing GNNs with very light computational cost. Extensive experiments show that NodeDup achieves 38.49%, 13.34%, and 6.76% improvements on isolated, low-degree, and warm nodes, respectively, on average across all datasets compared to GNNs and state-of-the-art cold-start methods.</abstract><doi>10.48550/arxiv.2402.09711</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2402.09711
ispartof
issn
language eng
recordid cdi_arxiv_primary_2402_09711
source arXiv.org
subjects Computer Science - Learning
Computer Science - Social and Information Networks
title Node Duplication Improves Cold-start Link Prediction
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T18%3A20%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Node%20Duplication%20Improves%20Cold-start%20Link%20Prediction&rft.au=Guo,%20Zhichun&rft.date=2024-02-15&rft_id=info:doi/10.48550/arxiv.2402.09711&rft_dat=%3Carxiv_GOX%3E2402_09711%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true