Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD

Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explicit connection between compressibility and generalization error. Recent studies have shown that the choice of the hyperpar...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Wan, Yijun, Barsbey, Melih, Zaidi, Abdellatif, Simsekli, Umut
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning Mathematics - Probability Statistics - Machine Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!