Balanced Energy Regularization Loss for Out-of-distribution Detection

In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Choi, Hyunjun, Jeong, Hawook, Choi, Jin Young
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Choi, Hyunjun
Jeong, Hawook
Choi, Jin Young
description In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.
doi_str_mv 10.48550/arxiv.2306.10485
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2306_10485</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2306_10485</sourcerecordid><originalsourceid>FETCH-LOGICAL-a675-de8794127c33c1bd6b2b937e87c66ea0e15c2ffac41b49ce3d41ad89f645756c3</originalsourceid><addsrcrecordid>eNotj8tKxDAYhbNxIaMP4Mq8QGrS3NqljvUChYFh9uVP8mcI1FbSVhyf3pnq6hy-Awc-Qu4EL1SlNX-A_J2-ilJyUwh-RtekeYIeBo-BNgPm44nu8bj0kNMPzGkcaDtOE41jprtlZmNkIU1zTm5Zx2ec0V_aDbmK0E94-58bcnhpDts31u5e37ePLQNjNQtY2VqJ0nopvXDBuNLV0p6pNwaBo9C-jBG8Ek7VHmVQAkJVR6O01cbLDbn_u109us-cPiCfuotPt_rIX-13Rkk</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Balanced Energy Regularization Loss for Out-of-distribution Detection</title><source>arXiv.org</source><creator>Choi, Hyunjun ; Jeong, Hawook ; Choi, Jin Young</creator><creatorcontrib>Choi, Hyunjun ; Jeong, Hawook ; Choi, Jin Young</creatorcontrib><description>In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.</description><identifier>DOI: 10.48550/arxiv.2306.10485</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning</subject><creationdate>2023-06</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2306.10485$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2306.10485$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Choi, Hyunjun</creatorcontrib><creatorcontrib>Jeong, Hawook</creatorcontrib><creatorcontrib>Choi, Jin Young</creatorcontrib><title>Balanced Energy Regularization Loss for Out-of-distribution Detection</title><description>In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj8tKxDAYhbNxIaMP4Mq8QGrS3NqljvUChYFh9uVP8mcI1FbSVhyf3pnq6hy-Awc-Qu4EL1SlNX-A_J2-ilJyUwh-RtekeYIeBo-BNgPm44nu8bj0kNMPzGkcaDtOE41jprtlZmNkIU1zTm5Zx2ec0V_aDbmK0E94-58bcnhpDts31u5e37ePLQNjNQtY2VqJ0nopvXDBuNLV0p6pNwaBo9C-jBG8Ek7VHmVQAkJVR6O01cbLDbn_u109us-cPiCfuotPt_rIX-13Rkk</recordid><startdate>20230618</startdate><enddate>20230618</enddate><creator>Choi, Hyunjun</creator><creator>Jeong, Hawook</creator><creator>Choi, Jin Young</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230618</creationdate><title>Balanced Energy Regularization Loss for Out-of-distribution Detection</title><author>Choi, Hyunjun ; Jeong, Hawook ; Choi, Jin Young</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a675-de8794127c33c1bd6b2b937e87c66ea0e15c2ffac41b49ce3d41ad89f645756c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Choi, Hyunjun</creatorcontrib><creatorcontrib>Jeong, Hawook</creatorcontrib><creatorcontrib>Choi, Jin Young</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Choi, Hyunjun</au><au>Jeong, Hawook</au><au>Choi, Jin Young</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Balanced Energy Regularization Loss for Out-of-distribution Detection</atitle><date>2023-06-18</date><risdate>2023</risdate><abstract>In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.</abstract><doi>10.48550/arxiv.2306.10485</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2306.10485
ispartof
issn
language eng
recordid cdi_arxiv_primary_2306_10485
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
title Balanced Energy Regularization Loss for Out-of-distribution Detection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-04T01%3A52%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Balanced%20Energy%20Regularization%20Loss%20for%20Out-of-distribution%20Detection&rft.au=Choi,%20Hyunjun&rft.date=2023-06-18&rft_id=info:doi/10.48550/arxiv.2306.10485&rft_dat=%3Carxiv_GOX%3E2306_10485%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true