Inductive reasoning with type-constrained encoding for emerging entities
Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-...
Gespeichert in:
Veröffentlicht in: | Neural networks 2024-10, Vol.178, p.106468, Article 106468 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 106468 |
container_title | Neural networks |
container_volume | 178 |
creator | Mu, Chong Zhang, Lizong Wang, Zhiguo Yuan, Qianghua Peng, Chengzong |
description | Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models.
•Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores. |
doi_str_mv | 10.1016/j.neunet.2024.106468 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_3073713773</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0893608024003927</els_id><sourcerecordid>3073713773</sourcerecordid><originalsourceid>FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</originalsourceid><addsrcrecordid>eNp9kE9LAzEQxYMotla_gcgevWzNn22SvQhS1BYKXvQc0mS2pnSzNclW-u3dZatHT8ObeTOP-SF0S_CUYMIftlMPrYc0pZgWXYsXXJ6hMZGizKmQ9ByNsSxZzrHEI3QV4xZjzGXBLtGIybJgktMxWiy9bU1yB8gC6Nh45zfZt0ufWTruITeNjylo58Fm4E1j-3HVhAxqCJtegE8uOYjX6KLSuwg3pzpBHy_P7_NFvnp7Xc6fVrlhhKS8MgYDlFVV8IoyaipRFtIKUs44FLQEYzohAAtuZ5wLCeuZ1hy45ZxrStZsgu6Hu_vQfLUQk6pdNLDbaQ9NGxXDggnChGCdtRisJjQxBqjUPrhah6MiWPUM1VYNDFXPUA0Mu7W7U0K7rsH-Lf1C6wyPgwG6Pw8OgorGdXTAugAmKdu4_xN-AEI4haQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3073713773</pqid></control><display><type>article</type><title>Inductive reasoning with type-constrained encoding for emerging entities</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</creator><creatorcontrib>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</creatorcontrib><description>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models.
•Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</description><identifier>ISSN: 0893-6080</identifier><identifier>ISSN: 1879-2782</identifier><identifier>EISSN: 1879-2782</identifier><identifier>DOI: 10.1016/j.neunet.2024.106468</identifier><identifier>PMID: 38943862</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Algorithms ; Computer Simulation ; Emerging entities encoding ; Humans ; Inductive reasoning ; Knowledge ; Knowledge graphs ; Machine Learning ; Neural Networks, Computer ; Semantics</subject><ispartof>Neural networks, 2024-10, Vol.178, p.106468, Article 106468</ispartof><rights>2024 Elsevier Ltd</rights><rights>Copyright © 2024 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</cites><orcidid>0000-0002-0719-9556 ; 0000-0002-1056-880X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0893608024003927$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65534</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38943862$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Mu, Chong</creatorcontrib><creatorcontrib>Zhang, Lizong</creatorcontrib><creatorcontrib>Wang, Zhiguo</creatorcontrib><creatorcontrib>Yuan, Qianghua</creatorcontrib><creatorcontrib>Peng, Chengzong</creatorcontrib><title>Inductive reasoning with type-constrained encoding for emerging entities</title><title>Neural networks</title><addtitle>Neural Netw</addtitle><description>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models.
•Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</description><subject>Algorithms</subject><subject>Computer Simulation</subject><subject>Emerging entities encoding</subject><subject>Humans</subject><subject>Inductive reasoning</subject><subject>Knowledge</subject><subject>Knowledge graphs</subject><subject>Machine Learning</subject><subject>Neural Networks, Computer</subject><subject>Semantics</subject><issn>0893-6080</issn><issn>1879-2782</issn><issn>1879-2782</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kE9LAzEQxYMotla_gcgevWzNn22SvQhS1BYKXvQc0mS2pnSzNclW-u3dZatHT8ObeTOP-SF0S_CUYMIftlMPrYc0pZgWXYsXXJ6hMZGizKmQ9ByNsSxZzrHEI3QV4xZjzGXBLtGIybJgktMxWiy9bU1yB8gC6Nh45zfZt0ufWTruITeNjylo58Fm4E1j-3HVhAxqCJtegE8uOYjX6KLSuwg3pzpBHy_P7_NFvnp7Xc6fVrlhhKS8MgYDlFVV8IoyaipRFtIKUs44FLQEYzohAAtuZ5wLCeuZ1hy45ZxrStZsgu6Hu_vQfLUQk6pdNLDbaQ9NGxXDggnChGCdtRisJjQxBqjUPrhah6MiWPUM1VYNDFXPUA0Mu7W7U0K7rsH-Lf1C6wyPgwG6Pw8OgorGdXTAugAmKdu4_xN-AEI4haQ</recordid><startdate>202410</startdate><enddate>202410</enddate><creator>Mu, Chong</creator><creator>Zhang, Lizong</creator><creator>Wang, Zhiguo</creator><creator>Yuan, Qianghua</creator><creator>Peng, Chengzong</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-0719-9556</orcidid><orcidid>https://orcid.org/0000-0002-1056-880X</orcidid></search><sort><creationdate>202410</creationdate><title>Inductive reasoning with type-constrained encoding for emerging entities</title><author>Mu, Chong ; Zhang, Lizong ; Wang, Zhiguo ; Yuan, Qianghua ; Peng, Chengzong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c311t-fcc0ee9ff46f232cf7948d71956e429eccd717e076d56678eb5aa6e6d666a21b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Algorithms</topic><topic>Computer Simulation</topic><topic>Emerging entities encoding</topic><topic>Humans</topic><topic>Inductive reasoning</topic><topic>Knowledge</topic><topic>Knowledge graphs</topic><topic>Machine Learning</topic><topic>Neural Networks, Computer</topic><topic>Semantics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mu, Chong</creatorcontrib><creatorcontrib>Zhang, Lizong</creatorcontrib><creatorcontrib>Wang, Zhiguo</creatorcontrib><creatorcontrib>Yuan, Qianghua</creatorcontrib><creatorcontrib>Peng, Chengzong</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Neural networks</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mu, Chong</au><au>Zhang, Lizong</au><au>Wang, Zhiguo</au><au>Yuan, Qianghua</au><au>Peng, Chengzong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Inductive reasoning with type-constrained encoding for emerging entities</atitle><jtitle>Neural networks</jtitle><addtitle>Neural Netw</addtitle><date>2024-10</date><risdate>2024</risdate><volume>178</volume><spage>106468</spage><pages>106468-</pages><artnum>106468</artnum><issn>0893-6080</issn><issn>1879-2782</issn><eissn>1879-2782</eissn><abstract>Knowledge graph reasoning, vital for addressing incompleteness and supporting applications, faces challenges with the continuous growth of graphs. To address this challenge, several inductive reasoning models for encoding emerging entities have been proposed. However, they do not consider the multi-batch emergence scenario, where new entities and new facts are usually added to knowledge graphs (KGs) in multiple batches in the order of their emergence. To simulate the continuous growth of knowledge graphs, a novel multi-batch emergence (MBE) scenario has recently been proposed. We propose a path-based inductive model to handle multi-batch entity growth, enhancing entity encoding with type information. Specifically, we observe a noteworthy pattern in which entity types at the head and tail of the same relation exhibit relative regularity. To utilize this regularity, we introduce a pair of learnable parameters for each relation, representing entity type features linked to the relation. The type features are dedicated to encoding and updating the features of entities. Meanwhile, our model incorporates a novel attention mechanism, combining statistical co-occurrence and semantic similarity of relations effectively for contextual information capture. After generating embeddings, we employ reinforcement learning for path reasoning. To reduce sparsity and expand the action space, our model generates soft candidate facts by grounding a set of soft path rules. Meanwhile, we incorporate the confidence scores of these facts in the action space to facilitate the agent to better distinguish between original facts and rule-generated soft facts. Performances on three multi-batch entity growth datasets demonstrate robust performance, consistently outperforming state-of-the-art models.
•Introduces entity type features for fine-grained entity encoding.•Proposes attention mechanism combining co-occurrence and similarity.•Alleviates KG sparsity with soft facts and confidence scores.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>38943862</pmid><doi>10.1016/j.neunet.2024.106468</doi><orcidid>https://orcid.org/0000-0002-0719-9556</orcidid><orcidid>https://orcid.org/0000-0002-1056-880X</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0893-6080 |
ispartof | Neural networks, 2024-10, Vol.178, p.106468, Article 106468 |
issn | 0893-6080 1879-2782 1879-2782 |
language | eng |
recordid | cdi_proquest_miscellaneous_3073713773 |
source | MEDLINE; Elsevier ScienceDirect Journals |
subjects | Algorithms Computer Simulation Emerging entities encoding Humans Inductive reasoning Knowledge Knowledge graphs Machine Learning Neural Networks, Computer Semantics |
title | Inductive reasoning with type-constrained encoding for emerging entities |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T22%3A25%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Inductive%20reasoning%20with%20type-constrained%20encoding%20for%20emerging%20entities&rft.jtitle=Neural%20networks&rft.au=Mu,%20Chong&rft.date=2024-10&rft.volume=178&rft.spage=106468&rft.pages=106468-&rft.artnum=106468&rft.issn=0893-6080&rft.eissn=1879-2782&rft_id=info:doi/10.1016/j.neunet.2024.106468&rft_dat=%3Cproquest_cross%3E3073713773%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3073713773&rft_id=info:pmid/38943862&rft_els_id=S0893608024003927&rfr_iscdi=true |