METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS

A computer-implemented method for training an artificial neural network with training data including samples and corresponding labels for performing a task includes: pre-training the artificial neural network to generate matrix representations that are invariant to a predetermined set of data augmen...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Karthik, Shyamgopal, Revaud, Jérome, Chidlovskii, Boris
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Karthik, Shyamgopal
Revaud, Jérome
Chidlovskii, Boris
description A computer-implemented method for training an artificial neural network with training data including samples and corresponding labels for performing a task includes: pre-training the artificial neural network to generate matrix representations that are invariant to a predetermined set of data augmentations applied to a sample, where the artificial neural network includes an encoder module and a projection module configured to generate the matrix representations based on ones of the samples, respectively; and after the pre-training, fine-tune training the artificial neural network using a loss function, wherein fine-tuning the artificial neural network includes adjusting, based on the labels, one or more weights of the projection module while maintaining constant weights of the encoder module, and where the loss function is based on a logit adjustment loss that is based on logits that are adjusted based on a class distribution of the training data.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_US2023169332A1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>US2023169332A1</sourcerecordid><originalsourceid>FETCH-epo_espacenet_US2023169332A13</originalsourceid><addsrcrecordid>eNqNyrEKwjAQANAsDqL-w4GzYBMQHK_JxQSSCyQR6VSKxEm0UP8fFz_A6S1vLWKk6pIBZANlKJUi2JQhonaeCQJhZs8XsDlF8LHHgKzJgMGKcPPVASdfBgjYUyhbsXpMz6Xtfm7E3lLV7tDm99iWebq3V_uM1yKPUnWns1ISO_Xf-gJqHy66</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS</title><source>esp@cenet</source><creator>Karthik, Shyamgopal ; Revaud, Jérome ; Chidlovskii, Boris</creator><creatorcontrib>Karthik, Shyamgopal ; Revaud, Jérome ; Chidlovskii, Boris</creatorcontrib><description>A computer-implemented method for training an artificial neural network with training data including samples and corresponding labels for performing a task includes: pre-training the artificial neural network to generate matrix representations that are invariant to a predetermined set of data augmentations applied to a sample, where the artificial neural network includes an encoder module and a projection module configured to generate the matrix representations based on ones of the samples, respectively; and after the pre-training, fine-tune training the artificial neural network using a loss function, wherein fine-tuning the artificial neural network includes adjusting, based on the labels, one or more weights of the projection module while maintaining constant weights of the encoder module, and where the loss function is based on a logit adjustment loss that is based on logits that are adjusted based on a class distribution of the training data.</description><language>eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; PHYSICS</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230601&amp;DB=EPODOC&amp;CC=US&amp;NR=2023169332A1$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230601&amp;DB=EPODOC&amp;CC=US&amp;NR=2023169332A1$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>Karthik, Shyamgopal</creatorcontrib><creatorcontrib>Revaud, Jérome</creatorcontrib><creatorcontrib>Chidlovskii, Boris</creatorcontrib><title>METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS</title><description>A computer-implemented method for training an artificial neural network with training data including samples and corresponding labels for performing a task includes: pre-training the artificial neural network to generate matrix representations that are invariant to a predetermined set of data augmentations applied to a sample, where the artificial neural network includes an encoder module and a projection module configured to generate the matrix representations based on ones of the samples, respectively; and after the pre-training, fine-tune training the artificial neural network using a loss function, wherein fine-tuning the artificial neural network includes adjusting, based on the labels, one or more weights of the projection module while maintaining constant weights of the encoder module, and where the loss function is based on a logit adjustment loss that is based on logits that are adjusted based on a class distribution of the training data.</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNyrEKwjAQANAsDqL-w4GzYBMQHK_JxQSSCyQR6VSKxEm0UP8fFz_A6S1vLWKk6pIBZANlKJUi2JQhonaeCQJhZs8XsDlF8LHHgKzJgMGKcPPVASdfBgjYUyhbsXpMz6Xtfm7E3lLV7tDm99iWebq3V_uM1yKPUnWns1ISO_Xf-gJqHy66</recordid><startdate>20230601</startdate><enddate>20230601</enddate><creator>Karthik, Shyamgopal</creator><creator>Revaud, Jérome</creator><creator>Chidlovskii, Boris</creator><scope>EVB</scope></search><sort><creationdate>20230601</creationdate><title>METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS</title><author>Karthik, Shyamgopal ; Revaud, Jérome ; Chidlovskii, Boris</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_US2023169332A13</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>Karthik, Shyamgopal</creatorcontrib><creatorcontrib>Revaud, Jérome</creatorcontrib><creatorcontrib>Chidlovskii, Boris</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Karthik, Shyamgopal</au><au>Revaud, Jérome</au><au>Chidlovskii, Boris</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS</title><date>2023-06-01</date><risdate>2023</risdate><abstract>A computer-implemented method for training an artificial neural network with training data including samples and corresponding labels for performing a task includes: pre-training the artificial neural network to generate matrix representations that are invariant to a predetermined set of data augmentations applied to a sample, where the artificial neural network includes an encoder module and a projection module configured to generate the matrix representations based on ones of the samples, respectively; and after the pre-training, fine-tune training the artificial neural network using a loss function, wherein fine-tuning the artificial neural network includes adjusting, based on the labels, one or more weights of the projection module while maintaining constant weights of the encoder module, and where the loss function is based on a logit adjustment loss that is based on logits that are adjusted based on a class distribution of the training data.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng
recordid cdi_epo_espacenet_US2023169332A1
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
title METHOD AND SYSTEM FOR MACHINE LEARNING FROM IMBALANCED DATA WITH NOISY LABELS
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T04%3A13%3A27IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=Karthik,%20Shyamgopal&rft.date=2023-06-01&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EUS2023169332A1%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true