Free Probability for predicting the performance of feed-forward fully connected neural networks

Advances in Neural Information Processing Systems (NeurIPS), Vol 35, 2439--2450, 2022 Gradient descent during the learning process of a neural network can be subject to many instabilities. The spectral density of the Jacobian is a key component for analyzing stability. Following the works of Penning...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Chhaibi, Reda, Daouda, Tariq, Kahn, Ezechiel
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Artificial Intelligence Computer Science - Learning Mathematics - Optimization and Control Mathematics - Probability Statistics - Machine Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!