Incorporating Physical Priors into Weakly-Supervised Anomaly Detection
We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Cheng, Chi Lung Singh, Gup Nachman, Benjamin |
description | We propose a new machine-learning-based anomaly detection strategy for
comparing data with a background-only reference (a form of weak supervision).
The sensitivity of previous strategies degrades significantly when the signal
is too rare or there are many unhelpful features. Our Prior-Assisted Weak
Supervision (PAWS) method incorporates information from a class of signal
models to significantly enhance the search sensitivity of weakly supervised
approaches. As long as the true signal is in the pre-specified class, PAWS
matches the sensitivity of a dedicated, fully supervised method without
specifying the exact parameters ahead of time. On the benchmark LHC Olympics
anomaly detection dataset, our mix of semi-supervised and weakly supervised
learning is able to extend the sensitivity over previous methods by a factor of
10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to
the inputs, classical methods degrade by another factor of 10 in cross section
while PAWS remains insensitive to noise. This new approach could be applied in
a number of scenarios and pushes the frontier of sensitivity between completely
model-agnostic approaches and fully model-specific searches. |
doi_str_mv | 10.48550/arxiv.2405.08889 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2405_08889</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2405_08889</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-983b8fcfd88ffc1c6cea038658fd0b04ccf735782890fcc876b99338104d10f23</originalsourceid><addsrcrecordid>eNotz0FrwjAYgOFcdhjOH7DT8gfafW2a9stR3HSCMGHCjiX9mmhYTUpaxf77Mefpvb3wMPacQVqglPCq49Vd0rwAmQIiqke22ngKsQ9Rj84f-O44DY50x3fRhThw58fAv43-6abk69ybeHGDafnCh5PuJv5mRkOjC_6JPVjdDWZ-74ztV-_75Uey_VxvlottostKJQpFg5Zsi2gtZVSS0SCwlGhbaKAgspWQFeaowBJhVTZKCYEZFG0GNhcz9vK_vUHqPrqTjlP9B6pvIPELozpG1A</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><source>arXiv.org</source><creator>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</creator><creatorcontrib>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</creatorcontrib><description>We propose a new machine-learning-based anomaly detection strategy for
comparing data with a background-only reference (a form of weak supervision).
The sensitivity of previous strategies degrades significantly when the signal
is too rare or there are many unhelpful features. Our Prior-Assisted Weak
Supervision (PAWS) method incorporates information from a class of signal
models to significantly enhance the search sensitivity of weakly supervised
approaches. As long as the true signal is in the pre-specified class, PAWS
matches the sensitivity of a dedicated, fully supervised method without
specifying the exact parameters ahead of time. On the benchmark LHC Olympics
anomaly detection dataset, our mix of semi-supervised and weakly supervised
learning is able to extend the sensitivity over previous methods by a factor of
10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to
the inputs, classical methods degrade by another factor of 10 in cross section
while PAWS remains insensitive to noise. This new approach could be applied in
a number of scenarios and pushes the frontier of sensitivity between completely
model-agnostic approaches and fully model-specific searches.</description><identifier>DOI: 10.48550/arxiv.2405.08889</identifier><language>eng</language><subject>Physics - High Energy Physics - Experiment ; Physics - High Energy Physics - Phenomenology</subject><creationdate>2024-05</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,778,883</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2405.08889$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2405.08889$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Cheng, Chi Lung</creatorcontrib><creatorcontrib>Singh, Gup</creatorcontrib><creatorcontrib>Nachman, Benjamin</creatorcontrib><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><description>We propose a new machine-learning-based anomaly detection strategy for
comparing data with a background-only reference (a form of weak supervision).
The sensitivity of previous strategies degrades significantly when the signal
is too rare or there are many unhelpful features. Our Prior-Assisted Weak
Supervision (PAWS) method incorporates information from a class of signal
models to significantly enhance the search sensitivity of weakly supervised
approaches. As long as the true signal is in the pre-specified class, PAWS
matches the sensitivity of a dedicated, fully supervised method without
specifying the exact parameters ahead of time. On the benchmark LHC Olympics
anomaly detection dataset, our mix of semi-supervised and weakly supervised
learning is able to extend the sensitivity over previous methods by a factor of
10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to
the inputs, classical methods degrade by another factor of 10 in cross section
while PAWS remains insensitive to noise. This new approach could be applied in
a number of scenarios and pushes the frontier of sensitivity between completely
model-agnostic approaches and fully model-specific searches.</description><subject>Physics - High Energy Physics - Experiment</subject><subject>Physics - High Energy Physics - Phenomenology</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz0FrwjAYgOFcdhjOH7DT8gfafW2a9stR3HSCMGHCjiX9mmhYTUpaxf77Mefpvb3wMPacQVqglPCq49Vd0rwAmQIiqke22ngKsQ9Rj84f-O44DY50x3fRhThw58fAv43-6abk69ybeHGDafnCh5PuJv5mRkOjC_6JPVjdDWZ-74ztV-_75Uey_VxvlottostKJQpFg5Zsi2gtZVSS0SCwlGhbaKAgspWQFeaowBJhVTZKCYEZFG0GNhcz9vK_vUHqPrqTjlP9B6pvIPELozpG1A</recordid><startdate>20240514</startdate><enddate>20240514</enddate><creator>Cheng, Chi Lung</creator><creator>Singh, Gup</creator><creator>Nachman, Benjamin</creator><scope>GOX</scope></search><sort><creationdate>20240514</creationdate><title>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</title><author>Cheng, Chi Lung ; Singh, Gup ; Nachman, Benjamin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-983b8fcfd88ffc1c6cea038658fd0b04ccf735782890fcc876b99338104d10f23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Physics - High Energy Physics - Experiment</topic><topic>Physics - High Energy Physics - Phenomenology</topic><toplevel>online_resources</toplevel><creatorcontrib>Cheng, Chi Lung</creatorcontrib><creatorcontrib>Singh, Gup</creatorcontrib><creatorcontrib>Nachman, Benjamin</creatorcontrib><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Cheng, Chi Lung</au><au>Singh, Gup</au><au>Nachman, Benjamin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Incorporating Physical Priors into Weakly-Supervised Anomaly Detection</atitle><date>2024-05-14</date><risdate>2024</risdate><abstract>We propose a new machine-learning-based anomaly detection strategy for
comparing data with a background-only reference (a form of weak supervision).
The sensitivity of previous strategies degrades significantly when the signal
is too rare or there are many unhelpful features. Our Prior-Assisted Weak
Supervision (PAWS) method incorporates information from a class of signal
models to significantly enhance the search sensitivity of weakly supervised
approaches. As long as the true signal is in the pre-specified class, PAWS
matches the sensitivity of a dedicated, fully supervised method without
specifying the exact parameters ahead of time. On the benchmark LHC Olympics
anomaly detection dataset, our mix of semi-supervised and weakly supervised
learning is able to extend the sensitivity over previous methods by a factor of
10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to
the inputs, classical methods degrade by another factor of 10 in cross section
while PAWS remains insensitive to noise. This new approach could be applied in
a number of scenarios and pushes the frontier of sensitivity between completely
model-agnostic approaches and fully model-specific searches.</abstract><doi>10.48550/arxiv.2405.08889</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2405.08889 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2405_08889 |
source | arXiv.org |
subjects | Physics - High Energy Physics - Experiment Physics - High Energy Physics - Phenomenology |
title | Incorporating Physical Priors into Weakly-Supervised Anomaly Detection |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T13%3A41%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Incorporating%20Physical%20Priors%20into%20Weakly-Supervised%20Anomaly%20Detection&rft.au=Cheng,%20Chi%20Lung&rft.date=2024-05-14&rft_id=info:doi/10.48550/arxiv.2405.08889&rft_dat=%3Carxiv_GOX%3E2405_08889%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |