Few-Shot Learning by Dimensionality Reduction in Gradient Space

Proceedings of The 1st Conference on Lifelong Learning Agents, PMLR 199:1043-1064 (2022) We introduce SubGD, a novel few-shot learning method which is based on the recent finding that stochastic gradient descent updates tend to live in a low-dimensional parameter subspace. In experimental and theore...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Gauch, Martin, Beck, Maximilian, Adler, Thomas, Kotsur, Dmytro, Fiel, Stefan, Eghbal-zadeh, Hamid, Brandstetter, Johannes, Kofler, Johannes, Holzleitner, Markus, Zellinger, Werner, Klotz, Daniel, Hochreiter, Sepp, Lehner, Sebastian
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!