Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN

The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model hetero...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhou, Zhilun, Fan, Jingyang, Liu, Yu, Xu, Fengli, Jin, Depeng, Li, Yong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Zhou, Zhilun
Fan, Jingyang
Liu, Yu
Xu, Fengli
Jin, Depeng
Li, Yong
description The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model heterogeneous LBSN data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs) in commonsense reasoning, embedding, and multi-agent collaboration, in this work, we synergize LLM agents and knowledge graph for socioeconomic prediction. We first construct a location-based knowledge graph (LBKG) to integrate multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to identify relevant meta-paths in the LBKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged for better socioeconomic prediction. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.
doi_str_mv 10.48550/arxiv.2411.00028
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2411_00028</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2411_00028</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2411_000283</originalsourceid><addsrcrecordid>eNqFjssKgkAUQGfTIqoPaNX9gWw0BbcVPSB7gO1lGK_TBb0jo1T29ZG0b3U2B84RYupLL4yjSC6Ue9HDC0Lf96SUQTwUl7RjdIbexAaS5AQrg9w2oDiHI9tniblB2DtV36GwDlKryaK2bCvScHWYk27JMhBDsk7PYzEoVNng5MeRmO22t81h3qez2lGlXJd9F7J-Yfnf-ABWSTtG</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><source>arXiv.org</source><creator>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</creator><creatorcontrib>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</creatorcontrib><description>The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model heterogeneous LBSN data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs) in commonsense reasoning, embedding, and multi-agent collaboration, in this work, we synergize LLM agents and knowledge graph for socioeconomic prediction. We first construct a location-based knowledge graph (LBKG) to integrate multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to identify relevant meta-paths in the LBKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged for better socioeconomic prediction. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.</description><identifier>DOI: 10.48550/arxiv.2411.00028</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computation and Language ; Computer Science - Learning ; Computer Science - Social and Information Networks</subject><creationdate>2024-10</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,777,882</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2411.00028$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2411.00028$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhou, Zhilun</creatorcontrib><creatorcontrib>Fan, Jingyang</creatorcontrib><creatorcontrib>Liu, Yu</creatorcontrib><creatorcontrib>Xu, Fengli</creatorcontrib><creatorcontrib>Jin, Depeng</creatorcontrib><creatorcontrib>Li, Yong</creatorcontrib><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><description>The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model heterogeneous LBSN data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs) in commonsense reasoning, embedding, and multi-agent collaboration, in this work, we synergize LLM agents and knowledge graph for socioeconomic prediction. We first construct a location-based knowledge graph (LBKG) to integrate multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to identify relevant meta-paths in the LBKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged for better socioeconomic prediction. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computation and Language</subject><subject>Computer Science - Learning</subject><subject>Computer Science - Social and Information Networks</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjssKgkAUQGfTIqoPaNX9gWw0BbcVPSB7gO1lGK_TBb0jo1T29ZG0b3U2B84RYupLL4yjSC6Ue9HDC0Lf96SUQTwUl7RjdIbexAaS5AQrg9w2oDiHI9tniblB2DtV36GwDlKryaK2bCvScHWYk27JMhBDsk7PYzEoVNng5MeRmO22t81h3qez2lGlXJd9F7J-Yfnf-ABWSTtG</recordid><startdate>20241029</startdate><enddate>20241029</enddate><creator>Zhou, Zhilun</creator><creator>Fan, Jingyang</creator><creator>Liu, Yu</creator><creator>Xu, Fengli</creator><creator>Jin, Depeng</creator><creator>Li, Yong</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20241029</creationdate><title>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</title><author>Zhou, Zhilun ; Fan, Jingyang ; Liu, Yu ; Xu, Fengli ; Jin, Depeng ; Li, Yong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2411_000283</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computation and Language</topic><topic>Computer Science - Learning</topic><topic>Computer Science - Social and Information Networks</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhou, Zhilun</creatorcontrib><creatorcontrib>Fan, Jingyang</creatorcontrib><creatorcontrib>Liu, Yu</creatorcontrib><creatorcontrib>Xu, Fengli</creatorcontrib><creatorcontrib>Jin, Depeng</creatorcontrib><creatorcontrib>Li, Yong</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhou, Zhilun</au><au>Fan, Jingyang</au><au>Liu, Yu</au><au>Xu, Fengli</au><au>Jin, Depeng</au><au>Li, Yong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN</atitle><date>2024-10-29</date><risdate>2024</risdate><abstract>The fast development of location-based social networks (LBSNs) has led to significant changes in society, resulting in popular studies of using LBSN data for socioeconomic prediction, e.g., regional population and commercial activity estimation. Existing studies design various graphs to model heterogeneous LBSN data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs) in commonsense reasoning, embedding, and multi-agent collaboration, in this work, we synergize LLM agents and knowledge graph for socioeconomic prediction. We first construct a location-based knowledge graph (LBKG) to integrate multi-sourced LBSN data. Then we leverage the reasoning power of LLM agent to identify relevant meta-paths in the LBKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged for better socioeconomic prediction. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.</abstract><doi>10.48550/arxiv.2411.00028</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2411.00028
ispartof
issn
language eng
recordid cdi_arxiv_primary_2411_00028
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computation and Language
Computer Science - Learning
Computer Science - Social and Information Networks
title Synergizing LLM Agents and Knowledge Graph for Socioeconomic Prediction in LBSN
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T20%3A59%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Synergizing%20LLM%20Agents%20and%20Knowledge%20Graph%20for%20Socioeconomic%20Prediction%20in%20LBSN&rft.au=Zhou,%20Zhilun&rft.date=2024-10-29&rft_id=info:doi/10.48550/arxiv.2411.00028&rft_dat=%3Carxiv_GOX%3E2411_00028%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true