Model training method and device and electronic device

The invention discloses a model training method and device and an electronic device, and relates to the technical field of deep learning. The specific implementation scheme is as follows: a first electronic device sends a gradient number to a second electronic device; receiving a first fusion gradie...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG HENGHUA, MENG KAI, LI ZHENGUO, LUO BAOTONG, HU ZAIBIN, LI PANPAN, HUANG KAIWEN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a model training method and device and an electronic device, and relates to the technical field of deep learning. The specific implementation scheme is as follows: a first electronic device sends a gradient number to a second electronic device; receiving a first fusion gradient sent by the second electronic device based on the gradient number; according to the first fusiongradient and a second fusion gradient, obtaining a target fusion gradient, obtaining the second fusion gradient by fusing N gradients taken out from a gradient queue corresponding to the first processor, wherein N is the number of gradients; sending the target fusion gradient to the second electronic device; and updating parameters of a learning model of the first electronic device according to the target fusion gradient. Due to the fact that gradient fusion is conducted on the N gradients through the first fusion gradient sent by the second electronic device, the communication frequency between the first electronic d