Data-dependence of plateau phenomenon in learning with neural network-statistical mechanical analysisThis article is an updated version of: Yoshida Y and Okada M 2019 Data-Dependence of plateau phenomenon in learning with neural network-statistical mechanical analysis 33rd Conf. Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada vol 32 eds H Wallach, H Larochelle, A Beygelzimer, F d'Alché-Buc, E Fox and R Garnett pp 1722-30

The plateau phenomenon, wherein the loss value stops decreasing during the process of learning, has been reported by various researchers. The phenomenon was actively inspected in the 1990s and found to be due to the fundamental hierarchical structure of neural network models. Then, the phenomenon ha...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Journal of statistical mechanics 2020-12, Vol.2020 (12)
Hauptverfasser:	Yoshida, Yuki, Okada, Masato
Format:	Artikel
Sprache:	eng
Schlagworte:	machine learning nonlinear dynamics online dynamics
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!