Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance

Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of impro...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2023-08
1. Verfasser: Yasuno, Takato
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Yasuno, Takato
description Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.
format Article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2841688865</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2841688865</sourcerecordid><originalsourceid>FETCH-proquest_journals_28416888653</originalsourceid><addsrcrecordid>eNqNysGKwjAUQNEgDChO_-GBG12UaVNbgztRiy7EjbgqyGv7qtEmqU2KDDL_PjPgB7i6i3N7bMCjKPTFlPM-86y9BkHAkxmP42jATEoP316Mg2ycKXSXvHqGX_iTTWChjcJakoWUqMyxuMEcVqjwTHCUVhoNO6mlPsO-aUzrOi3dN6AuYa1yKst_SQld1xJsVY416oI-2UeFtSXv1SEbpevDcuM3rbl3ZN3parpW_9GJi2mYCCGSOHrv-gWYDEkp</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2841688865</pqid></control><display><type>article</type><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><source>Free E- Journals</source><creator>Yasuno, Takato</creator><creatorcontrib>Yasuno, Takato</creatorcontrib><description>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Algorithms ; Anomalies ; Concrete deterioration ; Damage ; Data mining ; Datasets ; Deep learning ; Image classification ; Image segmentation ; Industrial applications ; Inspection ; Machine learning ; Object recognition ; Predictive maintenance ; Semantic segmentation ; Semantics ; Vision</subject><ispartof>arXiv.org, 2023-08</ispartof><rights>2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>777,781</link.rule.ids></links><search><creatorcontrib>Yasuno, Takato</creatorcontrib><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><title>arXiv.org</title><description>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</description><subject>Algorithms</subject><subject>Anomalies</subject><subject>Concrete deterioration</subject><subject>Damage</subject><subject>Data mining</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Image classification</subject><subject>Image segmentation</subject><subject>Industrial applications</subject><subject>Inspection</subject><subject>Machine learning</subject><subject>Object recognition</subject><subject>Predictive maintenance</subject><subject>Semantic segmentation</subject><subject>Semantics</subject><subject>Vision</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNqNysGKwjAUQNEgDChO_-GBG12UaVNbgztRiy7EjbgqyGv7qtEmqU2KDDL_PjPgB7i6i3N7bMCjKPTFlPM-86y9BkHAkxmP42jATEoP316Mg2ycKXSXvHqGX_iTTWChjcJakoWUqMyxuMEcVqjwTHCUVhoNO6mlPsO-aUzrOi3dN6AuYa1yKst_SQld1xJsVY416oI-2UeFtSXv1SEbpevDcuM3rbl3ZN3parpW_9GJi2mYCCGSOHrv-gWYDEkp</recordid><startdate>20230829</startdate><enddate>20230829</enddate><creator>Yasuno, Takato</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230829</creationdate><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><author>Yasuno, Takato</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28416888653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Anomalies</topic><topic>Concrete deterioration</topic><topic>Damage</topic><topic>Data mining</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Image classification</topic><topic>Image segmentation</topic><topic>Industrial applications</topic><topic>Inspection</topic><topic>Machine learning</topic><topic>Object recognition</topic><topic>Predictive maintenance</topic><topic>Semantic segmentation</topic><topic>Semantics</topic><topic>Vision</topic><toplevel>online_resources</toplevel><creatorcontrib>Yasuno, Takato</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yasuno, Takato</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</atitle><jtitle>arXiv.org</jtitle><date>2023-08-29</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2023-08
issn 2331-8422
language eng
recordid cdi_proquest_journals_2841688865
source Free E- Journals
subjects Algorithms
Anomalies
Concrete deterioration
Damage
Data mining
Datasets
Deep learning
Image classification
Image segmentation
Industrial applications
Inspection
Machine learning
Object recognition
Predictive maintenance
Semantic segmentation
Semantics
Vision
title Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T20%3A54%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Few-shot%20%5C(%5Cmathbf%7B1/a%7D%5C)%20Anomalies%20Feedback%20:%20Damage%20Vision%20Mining%20Opportunity%20and%20Embedding%20Feature%20Imbalance&rft.jtitle=arXiv.org&rft.au=Yasuno,%20Takato&rft.date=2023-08-29&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2841688865%3C/proquest%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2841688865&rft_id=info:pmid/&rfr_iscdi=true