Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance
Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of impro...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2023-08 |
---|---|
1. Verfasser: | |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Yasuno, Takato |
description | Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy. |
format | Article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2841688865</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2841688865</sourcerecordid><originalsourceid>FETCH-proquest_journals_28416888653</originalsourceid><addsrcrecordid>eNqNysGKwjAUQNEgDChO_-GBG12UaVNbgztRiy7EjbgqyGv7qtEmqU2KDDL_PjPgB7i6i3N7bMCjKPTFlPM-86y9BkHAkxmP42jATEoP316Mg2ycKXSXvHqGX_iTTWChjcJakoWUqMyxuMEcVqjwTHCUVhoNO6mlPsO-aUzrOi3dN6AuYa1yKst_SQld1xJsVY416oI-2UeFtSXv1SEbpevDcuM3rbl3ZN3parpW_9GJi2mYCCGSOHrv-gWYDEkp</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2841688865</pqid></control><display><type>article</type><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><source>Free E- Journals</source><creator>Yasuno, Takato</creator><creatorcontrib>Yasuno, Takato</creatorcontrib><description>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Algorithms ; Anomalies ; Concrete deterioration ; Damage ; Data mining ; Datasets ; Deep learning ; Image classification ; Image segmentation ; Industrial applications ; Inspection ; Machine learning ; Object recognition ; Predictive maintenance ; Semantic segmentation ; Semantics ; Vision</subject><ispartof>arXiv.org, 2023-08</ispartof><rights>2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>777,781</link.rule.ids></links><search><creatorcontrib>Yasuno, Takato</creatorcontrib><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><title>arXiv.org</title><description>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</description><subject>Algorithms</subject><subject>Anomalies</subject><subject>Concrete deterioration</subject><subject>Damage</subject><subject>Data mining</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Image classification</subject><subject>Image segmentation</subject><subject>Industrial applications</subject><subject>Inspection</subject><subject>Machine learning</subject><subject>Object recognition</subject><subject>Predictive maintenance</subject><subject>Semantic segmentation</subject><subject>Semantics</subject><subject>Vision</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNqNysGKwjAUQNEgDChO_-GBG12UaVNbgztRiy7EjbgqyGv7qtEmqU2KDDL_PjPgB7i6i3N7bMCjKPTFlPM-86y9BkHAkxmP42jATEoP316Mg2ycKXSXvHqGX_iTTWChjcJakoWUqMyxuMEcVqjwTHCUVhoNO6mlPsO-aUzrOi3dN6AuYa1yKst_SQld1xJsVY416oI-2UeFtSXv1SEbpevDcuM3rbl3ZN3parpW_9GJi2mYCCGSOHrv-gWYDEkp</recordid><startdate>20230829</startdate><enddate>20230829</enddate><creator>Yasuno, Takato</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230829</creationdate><title>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</title><author>Yasuno, Takato</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28416888653</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Anomalies</topic><topic>Concrete deterioration</topic><topic>Damage</topic><topic>Data mining</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Image classification</topic><topic>Image segmentation</topic><topic>Industrial applications</topic><topic>Inspection</topic><topic>Machine learning</topic><topic>Object recognition</topic><topic>Predictive maintenance</topic><topic>Semantic segmentation</topic><topic>Semantics</topic><topic>Vision</topic><toplevel>online_resources</toplevel><creatorcontrib>Yasuno, Takato</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yasuno, Takato</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance</atitle><jtitle>arXiv.org</jtitle><date>2023-08-29</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Over the past decade, previous balanced datasets have been used to advance deep learning algorithms for industrial applications. In urban infrastructures and living environments, damage data mining cannot avoid imbalanced data issues because of rare unseen events and the high-quality status of improved operations. For visual inspection, the deteriorated class acquired from the surface of concrete and steel components are occasionally imbalanced. From numerous related surveys, we conclude that imbalanced data problems can be categorised into four types: 1) missing range of target and label valuables, 2) majority-minority class imbalance, 3) foreground background of spatial imbalance, and 4) long-tailed class of pixel-wise imbalance. Since 2015, many imbalanced studies have been conducted using deep-learning approaches, including regression, image classification, object detection, and semantic segmentation. However, anomaly detection for imbalanced data is not well known. In this study, we highlight a one-class anomaly detection application, whether anomalous class or not, and demonstrate clear examples of imbalanced vision datasets: medical disease, hazardous behaviour, material deterioration, plant disease, river sludge, and disaster damage. We provide key results on the advantage of damage-vision mining, hypothesising that the more effective the range of the positive ratio, the higher the accuracy gain of the anomalies feedback. In our imbalanced studies, compared with the balanced case with a positive ratio of \(1/1\), we find that there is an applicable positive ratio \(1/a\) where the accuracy is consistently high. However, the extremely imbalanced range is from one shot to \(1/2a\), the accuracy of which is inferior to that of the applicable ratio. In contrast, with a positive ratio ranging over \(2/a\), it shifts in the over-mining phase without an effective gain in accuracy.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2023-08 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2841688865 |
source | Free E- Journals |
subjects | Algorithms Anomalies Concrete deterioration Damage Data mining Datasets Deep learning Image classification Image segmentation Industrial applications Inspection Machine learning Object recognition Predictive maintenance Semantic segmentation Semantics Vision |
title | Few-shot \(\mathbf{1/a}\) Anomalies Feedback : Damage Vision Mining Opportunity and Embedding Feature Imbalance |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T20%3A54%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Few-shot%20%5C(%5Cmathbf%7B1/a%7D%5C)%20Anomalies%20Feedback%20:%20Damage%20Vision%20Mining%20Opportunity%20and%20Embedding%20Feature%20Imbalance&rft.jtitle=arXiv.org&rft.au=Yasuno,%20Takato&rft.date=2023-08-29&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2841688865%3C/proquest%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2841688865&rft_id=info:pmid/&rfr_iscdi=true |