Accelerated Gradient Algorithms with Adaptive Subspace Search for Instance-Faster Optimization

Gradient-based minimax optimal algorithms have greatly promoted the development of continuous optimization and machine learning. One seminal work due to Yurii Nesterov [Nes83a] established \(\tilde{\mathcal{O}}(\sqrt{L/\mu})\) gradient complexity for minimizing an \(L\)-smooth \(\mu\)-strongly conve...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2023-12
Hauptverfasser:	Liu, Yuanshi, Zhao, Hanzhen, Xu, Yang, Pengyun Yue, Fang, Cong
Format:	Artikel
Sprache:	eng
Schlagworte:	Adaptive algorithms Algorithms Complexity Lower bounds Machine learning Minimax technique Optimization Regression analysis Smoothness
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!