Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework

Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework that integrates Bayesian principles with deep neural networks...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Duan, Minxuan, Qian, Yinlong, Zhao, Lingyi, Zhou, Zihao, Rasheed, Zeeshan, Yu, Rose, Shafique, Khurram
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Duan, Minxuan
Qian, Yinlong
Zhao, Lingyi
Zhou, Zihao
Rasheed, Zeeshan
Yu, Rose
Shafique, Khurram
description Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework that integrates Bayesian principles with deep neural networks to model the underlying multivariate distributions from sparse and complex datasets. Unlike traditional models, DeepBayesic is designed to manage heterogeneous inputs, accommodating both continuous and categorical data to provide a more comprehensive understanding of mobility patterns. The framework features customized neural density estimators and hybrid architectures, allowing for flexibility in modeling diverse feature distributions and enabling the use of specialized neural networks tailored to different data types. Our approach also leverages agent embeddings for personalized anomaly detection, enhancing its ability to distinguish between normal and anomalous behaviors for individual agents. We evaluate our approach on several mobility datasets, demonstrating significant improvements over state-of-the-art anomaly detection methods. Our results indicate that incorporating personalization and advanced sequence modeling techniques can substantially enhance the ability to detect subtle and complex anomalies in spatiotemporal event sequences.
doi_str_mv 10.48550/arxiv.2410.01011
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2410_01011</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2410_01011</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2410_010113</originalsourceid><addsrcrecordid>eNqFjrsKwkAQRbexEPUDrJwfUBMfIHY-iYU2ah3GuMYhya7MTozBnzcGe6t7uZwLR6mu7w0ms-nUGyK_6DkYTarB8z3fb6r3EqMExMISS-0ocnM4m8g-NZOJIcgzNLC3F0pJSliTE6ZLLmSNAzRXWBibYUraQUFyrybYGdExo-grHAWlelCEaQ0fdM5V3TJmurCctFXjhqnTnV-2VG-7Oa2Cfq0ZPpgy5DL86oa17vg_8QGbx0xu</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework</title><source>arXiv.org</source><creator>Duan, Minxuan ; Qian, Yinlong ; Zhao, Lingyi ; Zhou, Zihao ; Rasheed, Zeeshan ; Yu, Rose ; Shafique, Khurram</creator><creatorcontrib>Duan, Minxuan ; Qian, Yinlong ; Zhao, Lingyi ; Zhou, Zihao ; Rasheed, Zeeshan ; Yu, Rose ; Shafique, Khurram</creatorcontrib><description>Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework that integrates Bayesian principles with deep neural networks to model the underlying multivariate distributions from sparse and complex datasets. Unlike traditional models, DeepBayesic is designed to manage heterogeneous inputs, accommodating both continuous and categorical data to provide a more comprehensive understanding of mobility patterns. The framework features customized neural density estimators and hybrid architectures, allowing for flexibility in modeling diverse feature distributions and enabling the use of specialized neural networks tailored to different data types. Our approach also leverages agent embeddings for personalized anomaly detection, enhancing its ability to distinguish between normal and anomalous behaviors for individual agents. We evaluate our approach on several mobility datasets, demonstrating significant improvements over state-of-the-art anomaly detection methods. Our results indicate that incorporating personalization and advanced sequence modeling techniques can substantially enhance the ability to detect subtle and complex anomalies in spatiotemporal event sequences.</description><identifier>DOI: 10.48550/arxiv.2410.01011</identifier><language>eng</language><subject>Computer Science - Learning</subject><creationdate>2024-10</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2410.01011$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2410.01011$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Duan, Minxuan</creatorcontrib><creatorcontrib>Qian, Yinlong</creatorcontrib><creatorcontrib>Zhao, Lingyi</creatorcontrib><creatorcontrib>Zhou, Zihao</creatorcontrib><creatorcontrib>Rasheed, Zeeshan</creatorcontrib><creatorcontrib>Yu, Rose</creatorcontrib><creatorcontrib>Shafique, Khurram</creatorcontrib><title>Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework</title><description>Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework that integrates Bayesian principles with deep neural networks to model the underlying multivariate distributions from sparse and complex datasets. Unlike traditional models, DeepBayesic is designed to manage heterogeneous inputs, accommodating both continuous and categorical data to provide a more comprehensive understanding of mobility patterns. The framework features customized neural density estimators and hybrid architectures, allowing for flexibility in modeling diverse feature distributions and enabling the use of specialized neural networks tailored to different data types. Our approach also leverages agent embeddings for personalized anomaly detection, enhancing its ability to distinguish between normal and anomalous behaviors for individual agents. We evaluate our approach on several mobility datasets, demonstrating significant improvements over state-of-the-art anomaly detection methods. Our results indicate that incorporating personalization and advanced sequence modeling techniques can substantially enhance the ability to detect subtle and complex anomalies in spatiotemporal event sequences.</description><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjrsKwkAQRbexEPUDrJwfUBMfIHY-iYU2ah3GuMYhya7MTozBnzcGe6t7uZwLR6mu7w0ms-nUGyK_6DkYTarB8z3fb6r3EqMExMISS-0ocnM4m8g-NZOJIcgzNLC3F0pJSliTE6ZLLmSNAzRXWBibYUraQUFyrybYGdExo-grHAWlelCEaQ0fdM5V3TJmurCctFXjhqnTnV-2VG-7Oa2Cfq0ZPpgy5DL86oa17vg_8QGbx0xu</recordid><startdate>20241001</startdate><enddate>20241001</enddate><creator>Duan, Minxuan</creator><creator>Qian, Yinlong</creator><creator>Zhao, Lingyi</creator><creator>Zhou, Zihao</creator><creator>Rasheed, Zeeshan</creator><creator>Yu, Rose</creator><creator>Shafique, Khurram</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20241001</creationdate><title>Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework</title><author>Duan, Minxuan ; Qian, Yinlong ; Zhao, Lingyi ; Zhou, Zihao ; Rasheed, Zeeshan ; Yu, Rose ; Shafique, Khurram</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2410_010113</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Duan, Minxuan</creatorcontrib><creatorcontrib>Qian, Yinlong</creatorcontrib><creatorcontrib>Zhao, Lingyi</creatorcontrib><creatorcontrib>Zhou, Zihao</creatorcontrib><creatorcontrib>Rasheed, Zeeshan</creatorcontrib><creatorcontrib>Yu, Rose</creatorcontrib><creatorcontrib>Shafique, Khurram</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Duan, Minxuan</au><au>Qian, Yinlong</au><au>Zhao, Lingyi</au><au>Zhou, Zihao</au><au>Rasheed, Zeeshan</au><au>Yu, Rose</au><au>Shafique, Khurram</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework</atitle><date>2024-10-01</date><risdate>2024</risdate><abstract>Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework that integrates Bayesian principles with deep neural networks to model the underlying multivariate distributions from sparse and complex datasets. Unlike traditional models, DeepBayesic is designed to manage heterogeneous inputs, accommodating both continuous and categorical data to provide a more comprehensive understanding of mobility patterns. The framework features customized neural density estimators and hybrid architectures, allowing for flexibility in modeling diverse feature distributions and enabling the use of specialized neural networks tailored to different data types. Our approach also leverages agent embeddings for personalized anomaly detection, enhancing its ability to distinguish between normal and anomalous behaviors for individual agents. We evaluate our approach on several mobility datasets, demonstrating significant improvements over state-of-the-art anomaly detection methods. Our results indicate that incorporating personalization and advanced sequence modeling techniques can substantially enhance the ability to detect subtle and complex anomalies in spatiotemporal event sequences.</abstract><doi>10.48550/arxiv.2410.01011</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2410.01011
ispartof
issn
language eng
recordid cdi_arxiv_primary_2410_01011
source arXiv.org
subjects Computer Science - Learning
title Back to Bayesics: Uncovering Human Mobility Distributions and Anomalies with an Integrated Statistical and Neural Framework
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-09T17%3A30%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Back%20to%20Bayesics:%20Uncovering%20Human%20Mobility%20Distributions%20and%20Anomalies%20with%20an%20Integrated%20Statistical%20and%20Neural%20Framework&rft.au=Duan,%20Minxuan&rft.date=2024-10-01&rft_id=info:doi/10.48550/arxiv.2410.01011&rft_dat=%3Carxiv_GOX%3E2410_01011%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true