Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN
The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model hetero...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Zhou, Zhilun Fan, Jingyang Liu, Yu Xu, Fengli Jin, Depeng Li, Yong |
description | The fast development of location-based social networks (LBSNs) has led to
significant changes in society, resulting in popular studies of using LBSN data
for socioeconomic prediction, e.g., regional population and commercial activity
estimation. Existing studies design various graphs to model heterogeneous LBSN
data, and further apply graph representation learning methods for socioeconomic
prediction. However, these approaches heavily rely on heuristic ideas and
expertise to extract task-relevant knowledge from diverse data, which may not
be optimal for specific tasks. Additionally, they tend to overlook the inherent
relationships between different indicators, limiting the prediction accuracy.
Motivated by the remarkable abilities of large language models (LLMs) in
commonsense reasoning, embedding, and multi-agent collaboration, in this work,
we synergize LLM agents and knowledge graph for socioeconomic prediction. We
first construct a location-based knowledge graph (LBKG) to integrate
multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to
identify relevant meta-paths in the LBKG for each type of socioeconomic
prediction task, and design a semantic-guided attention module for knowledge
fusion with meta-paths. Moreover, we introduce a cross-task communication
mechanism to further enhance performance by enabling knowledge sharing across
tasks at both LLM agent and KG levels. On the one hand, the LLM agents for
different tasks collaborate to generate more diverse and comprehensive
meta-paths. On the other hand, the embeddings from different tasks are
adaptively merged for better socioeconomic prediction. Experiments on two
datasets demonstrate the effectiveness of the synergistic design between LLM
and KG, providing insights for information sharing across socioeconomic
prediction tasks. |
doi_str_mv | 10.48550/arxiv.2411.00028 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2411_00028</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2411_00028</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2411_000283</originalsourceid><addsrcrecordid>eNqFjssKgkAUQGfTIqoPaNX9gWw0BbcVPSB7gO1lGK_TBb0jo1T29ZG0b3U2B84RYupLL4yjSC6Ue9HDC0Lf96SUQTwUl7RjdIbexAaS5AQrg9w2oDiHI9tniblB2DtV36GwDlKryaK2bCvScHWYk27JMhBDsk7PYzEoVNng5MeRmO22t81h3qez2lGlXJd9F7J-Yfnf-ABWSTtG</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><source>arXiv.org</source><creator>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</creator><creatorcontrib>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</creatorcontrib><description>The fast development of location-based social networks (LBSNs) has led to
significant changes in society, resulting in popular studies of using LBSN data
for socioeconomic prediction, e.g., regional population and commercial activity
estimation. Existing studies design various graphs to model heterogeneous LBSN
data, and further apply graph representation learning methods for socioeconomic
prediction. However, these approaches heavily rely on heuristic ideas and
expertise to extract task-relevant knowledge from diverse data, which may not
be optimal for specific tasks. Additionally, they tend to overlook the inherent
relationships between different indicators, limiting the prediction accuracy.
Motivated by the remarkable abilities of large language models (LLMs) in
commonsense reasoning, embedding, and multi-agent collaboration, in this work,
we synergize LLM agents and knowledge graph for socioeconomic prediction. We
first construct a location-based knowledge graph (LBKG) to integrate
multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to
identify relevant meta-paths in the LBKG for each type of socioeconomic
prediction task, and design a semantic-guided attention module for knowledge
fusion with meta-paths. Moreover, we introduce a cross-task communication
mechanism to further enhance performance by enabling knowledge sharing across
tasks at both LLM agent and KG levels. On the one hand, the LLM agents for
different tasks collaborate to generate more diverse and comprehensive
meta-paths. On the other hand, the embeddings from different tasks are
adaptively merged for better socioeconomic prediction. Experiments on two
datasets demonstrate the effectiveness of the synergistic design between LLM
and KG, providing insights for information sharing across socioeconomic
prediction tasks.</description><identifier>DOI: 10.48550/arxiv.2411.00028</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computation and Language ; Computer Science - Learning ; Computer Science - Social and Information Networks</subject><creationdate>2024-10</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,777,882</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2411.00028$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2411.00028$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhou, Zhilun</creatorcontrib><creatorcontrib>Fan, Jingyang</creatorcontrib><creatorcontrib>Liu, Yu</creatorcontrib><creatorcontrib>Xu, Fengli</creatorcontrib><creatorcontrib>Jin, Depeng</creatorcontrib><creatorcontrib>Li, Yong</creatorcontrib><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><description>The fast development of location-based social networks (LBSNs) has led to
significant changes in society, resulting in popular studies of using LBSN data
for socioeconomic prediction, e.g., regional population and commercial activity
estimation. Existing studies design various graphs to model heterogeneous LBSN
data, and further apply graph representation learning methods for socioeconomic
prediction. However, these approaches heavily rely on heuristic ideas and
expertise to extract task-relevant knowledge from diverse data, which may not
be optimal for specific tasks. Additionally, they tend to overlook the inherent
relationships between different indicators, limiting the prediction accuracy.
Motivated by the remarkable abilities of large language models (LLMs) in
commonsense reasoning, embedding, and multi-agent collaboration, in this work,
we synergize LLM agents and knowledge graph for socioeconomic prediction. We
first construct a location-based knowledge graph (LBKG) to integrate
multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to
identify relevant meta-paths in the LBKG for each type of socioeconomic
prediction task, and design a semantic-guided attention module for knowledge
fusion with meta-paths. Moreover, we introduce a cross-task communication
mechanism to further enhance performance by enabling knowledge sharing across
tasks at both LLM agent and KG levels. On the one hand, the LLM agents for
different tasks collaborate to generate more diverse and comprehensive
meta-paths. On the other hand, the embeddings from different tasks are
adaptively merged for better socioeconomic prediction. Experiments on two
datasets demonstrate the effectiveness of the synergistic design between LLM
and KG, providing insights for information sharing across socioeconomic
prediction tasks.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computation and Language</subject><subject>Computer Science - Learning</subject><subject>Computer Science - Social and Information Networks</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjssKgkAUQGfTIqoPaNX9gWw0BbcVPSB7gO1lGK_TBb0jo1T29ZG0b3U2B84RYupLL4yjSC6Ue9HDC0Lf96SUQTwUl7RjdIbexAaS5AQrg9w2oDiHI9tniblB2DtV36GwDlKryaK2bCvScHWYk27JMhBDsk7PYzEoVNng5MeRmO22t81h3qez2lGlXJd9F7J-Yfnf-ABWSTtG</recordid><startdate>20241029</startdate><enddate>20241029</enddate><creator>Zhou, Zhilun</creator><creator>Fan, Jingyang</creator><creator>Liu, Yu</creator><creator>Xu, Fengli</creator><creator>Jin, Depeng</creator><creator>Li, Yong</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20241029</creationdate><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><author>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2411_000283</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computation and Language</topic><topic>Computer Science - Learning</topic><topic>Computer Science - Social and Information Networks</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhou, Zhilun</creatorcontrib><creatorcontrib>Fan, Jingyang</creatorcontrib><creatorcontrib>Liu, Yu</creatorcontrib><creatorcontrib>Xu, Fengli</creatorcontrib><creatorcontrib>Jin, Depeng</creatorcontrib><creatorcontrib>Li, Yong</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhou, Zhilun</au><au>Fan, Jingyang</au><au>Liu, Yu</au><au>Xu, Fengli</au><au>Jin, Depeng</au><au>Li, Yong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</atitle><date>2024-10-29</date><risdate>2024</risdate><abstract>The fast development of location-based social networks (LBSNs) has led to
significant changes in society, resulting in popular studies of using LBSN data
for socioeconomic prediction, e.g., regional population and commercial activity
estimation. Existing studies design various graphs to model heterogeneous LBSN
data, and further apply graph representation learning methods for socioeconomic
prediction. However, these approaches heavily rely on heuristic ideas and
expertise to extract task-relevant knowledge from diverse data, which may not
be optimal for specific tasks. Additionally, they tend to overlook the inherent
relationships between different indicators, limiting the prediction accuracy.
Motivated by the remarkable abilities of large language models (LLMs) in
commonsense reasoning, embedding, and multi-agent collaboration, in this work,
we synergize LLM agents and knowledge graph for socioeconomic prediction. We
first construct a location-based knowledge graph (LBKG) to integrate
multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to
identify relevant meta-paths in the LBKG for each type of socioeconomic
prediction task, and design a semantic-guided attention module for knowledge
fusion with meta-paths. Moreover, we introduce a cross-task communication
mechanism to further enhance performance by enabling knowledge sharing across
tasks at both LLM agent and KG levels. On the one hand, the LLM agents for
different tasks collaborate to generate more diverse and comprehensive
meta-paths. On the other hand, the embeddings from different tasks are
adaptively merged for better socioeconomic prediction. Experiments on two
datasets demonstrate the effectiveness of the synergistic design between LLM
and KG, providing insights for information sharing across socioeconomic
prediction tasks.</abstract><doi>10.48550/arxiv.2411.00028</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2411.00028 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2411_00028 |
source | arXiv.org |
subjects | Computer Science - Artificial Intelligence Computer Science - Computation and Language Computer Science - Learning Computer Science - Social and Information Networks |
title | Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T20%3A59%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Synergizing%20LLM%20Agents%20and%20Knowledge%20Graph%20for%20Socioeconomic%20Prediction%20in%20LBSN&rft.au=Zhou,%20Zhilun&rft.date=2024-10-29&rft_id=info:doi/10.48550/arxiv.2411.00028&rft_dat=%3Carxiv_GOX%3E2411_00028%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |