UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM

UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM

A data processing system comprising a plurality of processing nodes that are arranged to update a model in a parallel manner Each of the processing nodes starts with a different set of updates to model parameters. Each of the processing nodes is configured to perform one or more reduce-scatter colle...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: TØRUDBAKKEN, Ola, CEVOLANI, Lorenzo
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator TØRUDBAKKEN, Ola
CEVOLANI, Lorenzo
description A data processing system comprising a plurality of processing nodes that are arranged to update a model in a parallel manner Each of the processing nodes starts with a different set of updates to model parameters. Each of the processing nodes is configured to perform one or more reduce-scatter collectives so as to exchange and reduce the updates. Having done so, each processing node is configured to apply the reduced set of updates to obtain an updated set of model parameters. The processing nodes then exchange the updated model parameters using an all-gather so that each processing node ends up with the same model parameters at the end of the process.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_EP4111322A1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>EP4111322A1</sourcerecordid><originalsourceid>FETCH-epo_espacenet_EP4111322A13</originalsourceid><addsrcrecordid>eNrjZLAKDXBxDHFV8HdT8PV3cfVRCHAMcvR1DXENClbw9FNwBPN9fEASQf7OrsHBnn7uCsGRwSGuvjwMrGmJOcWpvFCam0HBzTXE2UM3tSA_PrW4IDE5NS-1JN41wMTQ0NDYyMjR0JgIJQBPVShp</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM</title><source>esp@cenet</source><creator>TØRUDBAKKEN, Ola ; CEVOLANI, Lorenzo</creator><creatorcontrib>TØRUDBAKKEN, Ola ; CEVOLANI, Lorenzo</creatorcontrib><description>A data processing system comprising a plurality of processing nodes that are arranged to update a model in a parallel manner Each of the processing nodes starts with a different set of updates to model parameters. Each of the processing nodes is configured to perform one or more reduce-scatter collectives so as to exchange and reduce the updates. Having done so, each processing node is configured to apply the reduced set of updates to obtain an updated set of model parameters. The processing nodes then exchange the updated model parameters using an all-gather so that each processing node ends up with the same model parameters at the end of the process.</description><language>eng ; fre ; ger</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230104&amp;DB=EPODOC&amp;CC=EP&amp;NR=4111322A1$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,776,881,25542,76516</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230104&amp;DB=EPODOC&amp;CC=EP&amp;NR=4111322A1$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>TØRUDBAKKEN, Ola</creatorcontrib><creatorcontrib>CEVOLANI, Lorenzo</creatorcontrib><title>UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM</title><description>A data processing system comprising a plurality of processing nodes that are arranged to update a model in a parallel manner Each of the processing nodes starts with a different set of updates to model parameters. Each of the processing nodes is configured to perform one or more reduce-scatter collectives so as to exchange and reduce the updates. Having done so, each processing node is configured to apply the reduced set of updates to obtain an updated set of model parameters. The processing nodes then exchange the updated model parameters using an all-gather so that each processing node ends up with the same model parameters at the end of the process.</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZLAKDXBxDHFV8HdT8PV3cfVRCHAMcvR1DXENClbw9FNwBPN9fEASQf7OrsHBnn7uCsGRwSGuvjwMrGmJOcWpvFCam0HBzTXE2UM3tSA_PrW4IDE5NS-1JN41wMTQ0NDYyMjR0JgIJQBPVShp</recordid><startdate>20230104</startdate><enddate>20230104</enddate><creator>TØRUDBAKKEN, Ola</creator><creator>CEVOLANI, Lorenzo</creator><scope>EVB</scope></search><sort><creationdate>20230104</creationdate><title>UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM</title><author>TØRUDBAKKEN, Ola ; CEVOLANI, Lorenzo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_EP4111322A13</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng ; fre ; ger</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>TØRUDBAKKEN, Ola</creatorcontrib><creatorcontrib>CEVOLANI, Lorenzo</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>TØRUDBAKKEN, Ola</au><au>CEVOLANI, Lorenzo</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM</title><date>2023-01-04</date><risdate>2023</risdate><abstract>A data processing system comprising a plurality of processing nodes that are arranged to update a model in a parallel manner Each of the processing nodes starts with a different set of updates to model parameters. Each of the processing nodes is configured to perform one or more reduce-scatter collectives so as to exchange and reduce the updates. Having done so, each processing node is configured to apply the reduced set of updates to obtain an updated set of model parameters. The processing nodes then exchange the updated model parameters using an all-gather so that each processing node ends up with the same model parameters at the end of the process.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng ; fre ; ger
recordid cdi_epo_espacenet_EP4111322A1
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
title UPDATE OF MODEL PARAMETERS IN A PARALLEL PROCESSING SYSTEM
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T22%3A51%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=T%C3%98RUDBAKKEN,%20Ola&rft.date=2023-01-04&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EEP4111322A1%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true