Incorporating Physical Priors into Weakly-Supervised Anomaly Detection

We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cheng, Chi Lung, Singh, Gup, Nachman, Benjamin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Cheng, Chi Lung
Singh, Gup
Nachman, Benjamin
description We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the pre-specified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semi-supervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.
doi_str_mv 10.48550/arxiv.2405.08889
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2405_08889</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2405_08889</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-983b8fcfd88ffc1c6cea038658fd0b04ccf735782890fcc876b99338104d10f23</originalsourceid><addsrcrecordid>eNotz0FrwjAYgOFcdhjOH7DT8gfafW2a9stR3HSCMGHCjiX9mmhYTUpaxf77Mefpvb3wMPacQVqglPCq49Vd0rwAmQIiqke22ngKsQ9Rj84f-O44DY50x3fRhThw58fAv43-6abk69ybeHGDafnCh5PuJv5mRkOjC_6JPVjdDWZ-74ztV-_75Uey_VxvlottostKJQpFg5Zsi2gtZVSS0SCwlGhbaKAgspWQFeaowBJhVTZKCYEZFG0GNhcz9vK_vUHqPrqTjlP9B6pvIPELozpG1A</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><source>arXiv.org</source><creator>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</creator><creatorcontrib>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</creatorcontrib><description>We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the pre-specified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semi-supervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.</description><identifier>DOI: 10.48550/arxiv.2405.08889</identifier><language>eng</language><subject>Physics - High Energy Physics - Experiment ; Physics - High Energy Physics - Phenomenology</subject><creationdate>2024-05</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,778,883</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2405.08889$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2405.08889$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Cheng, Chi Lung</creatorcontrib><creatorcontrib>Singh, Gup</creatorcontrib><creatorcontrib>Nachman, Benjamin</creatorcontrib><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><description>We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the pre-specified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semi-supervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.</description><subject>Physics - High Energy Physics - Experiment</subject><subject>Physics - High Energy Physics - Phenomenology</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz0FrwjAYgOFcdhjOH7DT8gfafW2a9stR3HSCMGHCjiX9mmhYTUpaxf77Mefpvb3wMPacQVqglPCq49Vd0rwAmQIiqke22ngKsQ9Rj84f-O44DY50x3fRhThw58fAv43-6abk69ybeHGDafnCh5PuJv5mRkOjC_6JPVjdDWZ-74ztV-_75Uey_VxvlottostKJQpFg5Zsi2gtZVSS0SCwlGhbaKAgspWQFeaowBJhVTZKCYEZFG0GNhcz9vK_vUHqPrqTjlP9B6pvIPELozpG1A</recordid><startdate>20240514</startdate><enddate>20240514</enddate><creator>Cheng, Chi Lung</creator><creator>Singh, Gup</creator><creator>Nachman, Benjamin</creator><scope>GOX</scope></search><sort><creationdate>20240514</creationdate><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><author>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-983b8fcfd88ffc1c6cea038658fd0b04ccf735782890fcc876b99338104d10f23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Physics - High Energy Physics - Experiment</topic><topic>Physics - High Energy Physics - Phenomenology</topic><toplevel>online_resources</toplevel><creatorcontrib>Cheng, Chi Lung</creatorcontrib><creatorcontrib>Singh, Gup</creatorcontrib><creatorcontrib>Nachman, Benjamin</creatorcontrib><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Cheng, Chi Lung</au><au>Singh, Gup</au><au>Nachman, Benjamin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</atitle><date>2024-05-14</date><risdate>2024</risdate><abstract>We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the pre-specified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semi-supervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.</abstract><doi>10.48550/arxiv.2405.08889</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2405.08889
ispartof
issn
language eng
recordid cdi_arxiv_primary_2405_08889
source arXiv.org
subjects Physics - High Energy Physics - Experiment
Physics - High Energy Physics - Phenomenology
title Incorporating Physical Priors into Weakly-Supervised Anomaly Detection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T13%3A41%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Incorporating%20Physical%20Priors%20into%20Weakly-Supervised%20Anomaly%20Detection&rft.au=Cheng,%20Chi%20Lung&rft.date=2024-05-14&rft_id=info:doi/10.48550/arxiv.2405.08889&rft_dat=%3Carxiv_GOX%3E2405_08889%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true