Batch normalization layer training method

Disclosed is a batch normalization layer training method, which may be used in a neural network learning apparatus having limited operational processing capability and storage space. A batch normalization layer training method according to an embodiment of the present disclosure may perform batch no...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Oh, Seung-Kyun, Kim, Sanghoon, Im, Jinseok
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Disclosed is a batch normalization layer training method, which may be used in a neural network learning apparatus having limited operational processing capability and storage space. A batch normalization layer training method according to an embodiment of the present disclosure may perform batch normalization transform by setting the gradients of the standard deviation and the mean of the loss function to zero, and applying a normalized statistic value obtained from an initial neural network or a previous neural network to the gradient of the loss function. The neural network learning apparatus of the present disclosure may be connected or converged with an Artificial Intelligence module, an Unmanned Aerial Vehicle (UAV), a robot, an Augmented Reality (AR) apparatus, a Virtual Reality (VR), a 5G network service-related apparatus, etc.