Toward Moderate Overparameterization: Global Convergence Guarantees for Training Shallow Neural Networks

Many modern neural network architectures are trained in an overparameterized regime where the parameters of the model exceed the size of the training dataset. Sufficiently overparameterized neural network architectures in principle have the capacity to fit any set of labels including random noise. H...

Ausführliche Beschreibung