Neural Networks Learn Statistics of Increasing Complexity

The distributional simplicity bias (DSB) posits that neural networks learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we present compelling new evidence for the DSB by showing that networks automatically learn to perform well on max...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Belrose, Nora, Pope, Quintin, Quirke, Lucia, Mallen, Alex, Fern, Xiaoli
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!