LEARNING A TRUNCATION RANK OF SINGULAR VALUE DECOMPOSED MATRICES REPRESENTING WEIGHT TENSORS IN NEURAL NETWORKS

LEARNING A TRUNCATION RANK OF SINGULAR VALUE DECOMPOSED MATRICES REPRESENTING WEIGHT TENSORS IN NEURAL NETWORKS

An apparatus for learning a rank of an artificial neural network is configured to decompose a weight tensor into a first weight tensor and a second weight tensor. A set of rank selection parameters are applied to the first weight tensor and the second weight tensor to truncate the rank of the first...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: KRISHNAMOORTHI, Raghuraman, TOWAL, Regan Blythe
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:An apparatus for learning a rank of an artificial neural network is configured to decompose a weight tensor into a first weight tensor and a second weight tensor. A set of rank selection parameters are applied to the first weight tensor and the second weight tensor to truncate the rank of the first weight tensor and the second weight tensor. The set of rank selection parameters are updated simultaneously with the weight tensors by averaging updates calculated for each rank selection parameter of the set of rank selection parameters.