Inductive reasoning with type-constrained encoding for emerging entities

Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Neural networks 2024-10, Vol.178, p.106468, Article 106468
Hauptverfasser: Mu, Chong, Zhang, Lizong, Wang, Zhiguo, Yuan, Qianghua, Peng, Chengzong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 106468
container_title Neural networks
container_volume 178
creator Mu, Chong
Zhang, Lizong
Wang, Zhiguo
Yuan, Qianghua
Peng, Chengzong
description Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models. •Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.
doi_str_mv 10.1016/j.neunet.2024.106468
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_3073713773</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0893608024003927</els_id><sourcerecordid>3073713773</sourcerecordid><originalsourceid>FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</originalsourceid><addsrcrecordid>eNp9kE9LAzEQxYMotla_gcgevWzNn22SvQhS1BYKXvQc0mS2pnSzNclW-u3dZatHT8ObeTOP-SF0S_CUYMIftlMPrYc0pZgWXYsXXJ6hMZGizKmQ9ByNsSxZzrHEI3QV4xZjzGXBLtGIybJgktMxWiy9bU1yB8gC6Nh45zfZt0ufWTruITeNjylo58Fm4E1j-3HVhAxqCJtegE8uOYjX6KLSuwg3pzpBHy_P7_NFvnp7Xc6fVrlhhKS8MgYDlFVV8IoyaipRFtIKUs44FLQEYzohAAtuZ5wLCeuZ1hy45ZxrStZsgu6Hu_vQfLUQk6pdNLDbaQ9NGxXDggnChGCdtRisJjQxBqjUPrhah6MiWPUM1VYNDFXPUA0Mu7W7U0K7rsH-Lf1C6wyPgwG6Pw8OgorGdXTAugAmKdu4_xN-AEI4haQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3073713773</pqid></control><display><type>article</type><title>Inductive reasoning with type-constrained encoding for emerging entities</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</creator><creatorcontrib>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</creatorcontrib><description>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models. •Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</description><identifier>ISSN: 0893-6080</identifier><identifier>ISSN: 1879-2782</identifier><identifier>EISSN: 1879-2782</identifier><identifier>DOI: 10.1016/j.neunet.2024.106468</identifier><identifier>PMID: 38943862</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Algorithms ; Computer Simulation ; Emerging entities encoding ; Humans ; Inductive reasoning ; Knowledge ; Knowledge graphs ; Machine Learning ; Neural Networks, Computer ; Semantics</subject><ispartof>Neural networks, 2024-10, Vol.178, p.106468, Article 106468</ispartof><rights>2024 Elsevier Ltd</rights><rights>Copyright © 2024 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</cites><orcidid>0000-0002-0719-9556 ; 0000-0002-1056-880X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0893608024003927$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65534</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38943862$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Mu, Chong</creatorcontrib><creatorcontrib>Zhang, Lizong</creatorcontrib><creatorcontrib>Wang, Zhiguo</creatorcontrib><creatorcontrib>Yuan, Qianghua</creatorcontrib><creatorcontrib>Peng, Chengzong</creatorcontrib><title>Inductive reasoning with type-constrained encoding for emerging entities</title><title>Neural networks</title><addtitle>Neural Netw</addtitle><description>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models. •Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</description><subject>Algorithms</subject><subject>Computer Simulation</subject><subject>Emerging entities encoding</subject><subject>Humans</subject><subject>Inductive reasoning</subject><subject>Knowledge</subject><subject>Knowledge graphs</subject><subject>Machine Learning</subject><subject>Neural Networks, Computer</subject><subject>Semantics</subject><issn>0893-6080</issn><issn>1879-2782</issn><issn>1879-2782</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kE9LAzEQxYMotla_gcgevWzNn22SvQhS1BYKXvQc0mS2pnSzNclW-u3dZatHT8ObeTOP-SF0S_CUYMIftlMPrYc0pZgWXYsXXJ6hMZGizKmQ9ByNsSxZzrHEI3QV4xZjzGXBLtGIybJgktMxWiy9bU1yB8gC6Nh45zfZt0ufWTruITeNjylo58Fm4E1j-3HVhAxqCJtegE8uOYjX6KLSuwg3pzpBHy_P7_NFvnp7Xc6fVrlhhKS8MgYDlFVV8IoyaipRFtIKUs44FLQEYzohAAtuZ5wLCeuZ1hy45ZxrStZsgu6Hu_vQfLUQk6pdNLDbaQ9NGxXDggnChGCdtRisJjQxBqjUPrhah6MiWPUM1VYNDFXPUA0Mu7W7U0K7rsH-Lf1C6wyPgwG6Pw8OgorGdXTAugAmKdu4_xN-AEI4haQ</recordid><startdate>202410</startdate><enddate>202410</enddate><creator>Mu, Chong</creator><creator>Zhang, Lizong</creator><creator>Wang, Zhiguo</creator><creator>Yuan, Qianghua</creator><creator>Peng, Chengzong</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-0719-9556</orcidid><orcidid>https://orcid.org/0000-0002-1056-880X</orcidid></search><sort><creationdate>202410</creationdate><title>Inductive reasoning with type-constrained encoding for emerging entities</title><author>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Algorithms</topic><topic>Computer Simulation</topic><topic>Emerging entities encoding</topic><topic>Humans</topic><topic>Inductive reasoning</topic><topic>Knowledge</topic><topic>Knowledge graphs</topic><topic>Machine Learning</topic><topic>Neural Networks, Computer</topic><topic>Semantics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mu, Chong</creatorcontrib><creatorcontrib>Zhang, Lizong</creatorcontrib><creatorcontrib>Wang, Zhiguo</creatorcontrib><creatorcontrib>Yuan, Qianghua</creatorcontrib><creatorcontrib>Peng, Chengzong</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Neural networks</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mu, Chong</au><au>Zhang, Lizong</au><au>Wang, Zhiguo</au><au>Yuan, Qianghua</au><au>Peng, Chengzong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Inductive reasoning with type-constrained encoding for emerging entities</atitle><jtitle>Neural networks</jtitle><addtitle>Neural Netw</addtitle><date>2024-10</date><risdate>2024</risdate><volume>178</volume><spage>106468</spage><pages>106468-</pages><artnum>106468</artnum><issn>0893-6080</issn><issn>1879-2782</issn><eissn>1879-2782</eissn><abstract>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models. •Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>38943862</pmid><doi>10.1016/j.neunet.2024.106468</doi><orcidid>https://orcid.org/0000-0002-0719-9556</orcidid><orcidid>https://orcid.org/0000-0002-1056-880X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0893-6080
ispartof Neural networks, 2024-10, Vol.178, p.106468, Article 106468
issn 0893-6080
1879-2782
1879-2782
language eng
recordid cdi_proquest_miscellaneous_3073713773
source MEDLINE; Elsevier ScienceDirect Journals
subjects Algorithms
Computer Simulation
Emerging entities encoding
Humans
Inductive reasoning
Knowledge
Knowledge graphs
Machine Learning
Neural Networks, Computer
Semantics
title Inductive reasoning with type-constrained encoding for emerging entities
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T22%3A25%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Inductive%20reasoning%20with%20type-constrained%20encoding%20for%20emerging%20entities&rft.jtitle=Neural%20networks&rft.au=Mu,%20Chong&rft.date=2024-10&rft.volume=178&rft.spage=106468&rft.pages=106468-&rft.artnum=106468&rft.issn=0893-6080&rft.eissn=1879-2782&rft_id=info:doi/10.1016/j.neunet.2024.106468&rft_dat=%3Cproquest_cross%3E3073713773%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3073713773&rft_id=info:pmid/38943862&rft_els_id=S0893608024003927&rfr_iscdi=true