Model training method and device and electronic device
The invention discloses a model training method and device and an electronic device, and relates to the technical field of deep learning. The specific implementation scheme is as follows: a first electronic device sends a gradient number to a second electronic device; receiving a first fusion gradie...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a model training method and device and an electronic device, and relates to the technical field of deep learning. The specific implementation scheme is as follows: a first electronic device sends a gradient number to a second electronic device; receiving a first fusion gradient sent by the second electronic device based on the gradient number; according to the first fusiongradient and a second fusion gradient, obtaining a target fusion gradient, obtaining the second fusion gradient by fusing N gradients taken out from a gradient queue corresponding to the first processor, wherein N is the number of gradients; sending the target fusion gradient to the second electronic device; and updating parameters of a learning model of the first electronic device according to the target fusion gradient. Due to the fact that gradient fusion is conducted on the N gradients through the first fusion gradient sent by the second electronic device, the communication frequency between the first electronic d |
---|