Gradient Methods for Problems with Inexact Model of the Objective

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes \((\delta,L)\) inexact oracle and relative smoothness condition. We analyze gradient method which u...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2019-03
Hauptverfasser: Stonyakin, Fedor, Dvinskikh, Darina, Dvurechensky, Pavel, Kroshnin, Alexey, Kuznetsova, Olesya, Agafonov, Artem, Gasnikov, Alexander, Tyurin, Alexander, Uribe, César A, Pasechnyuk, Dmitry, Artamonov, Sergei
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes \((\delta,L)\) inexact oracle and relative smoothness condition. We analyze gradient method which uses this inexact model and obtain convergence rates for convex and strongly convex problems. To show potential applications of our general framework we consider three particular problems. The first one is clustering by electorial model introduced in [Nesterov, 2018]. The second one is approximating optimal transport distance, for which we propose a Proximal Sinkhorn algorithm. The third one is devoted to approximating optimal transport barycenter and we propose a Proximal Iterative Bregman Projections algorithm. We also illustrate the practical performance of our algorithms by numerical experiments.
ISSN:2331-8422