Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects

In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$, where $\nabla\Phi$ is the gradient of a convex continuously di...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Attouch, H, Chbani, Z
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Attouch, H
Chbani, Z
description In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$, where $\nabla\Phi$ is the gradient of a convex continuously differentiable function $\Phi: \mathcal H \to \mathbb R$, $\alpha$ is a positive parameter, and $g: [t_0, + \infty[ \rightarrow \mathcal H$ is a "small" perturbation term. In this damped inertial system, the viscous damping coefficient $\frac{\alpha}{t}$ vanishes asymptotically, but not too rapidly. For $\alpha \geq 3$, and $\int_{t_0}^{+\infty} t \|g(t)\| dt < + \infty$, just assuming that the solution set is non empty, we show that any trajectory of the above system satisfies the fast convergence property $\Phi(x(t))- \min_{\mathcal H}\Phi \leq \frac{C}{t^2}$. For $\alpha > 3$, we show that any trajectory converges weakly to a minimizer of $\Phi$, and we show the strong convergence property in various practical situations. This complements the results obtained by Su-Boyd- Cand\`es, and Attouch-Peypouquet-Redont, in the unperturbed case $g=0$. The parallel study of the time discretized version of this system provides new insight on the effect of errors, or perturbations on Nesterov's type algorithms. We obtain fast convergence of the values, and convergence of the trajectories for a perturbed version of the variant of FISTA recently considered by Chambolle-Dossal, and Su-Boyd-Cand\`es.
doi_str_mv 10.48550/arxiv.1507.01367
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1507_01367</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1507_01367</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-de2c4217bfc1ba78f1877b2031ce5e8bc23375f0fdee03b7e09ffc32fc3eea173</originalsourceid><addsrcrecordid>eNotj81Kw0AUhWfjQqoP4Mp5gcT5aXrjshSjhYIFs3AX7kzu6ED-mBlL69Mbo4vD4cA5Bz7G7qTI12VRiAcMZ3_KZSEgF1Jv4Jq9VxgT9wOF5LHj7WXA3tvIcWh5tX-rtxy7jzH49NnHucbtOJzozMcp-d5_Y_LjkPPjvP4KZkkc40Q2xRt25bCLdPvvK1ZXT_XuJTu8Pu9320OGG4CsJWXXSoJxVhqE0skSwCihpaWCSmOV1lA44VoioQ2QeHTOajWLCCXoFbv_u13Qmin4HsOl-UVsFkT9A4EkTgg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects</title><source>arXiv.org</source><creator>Attouch, H ; Chbani, Z</creator><creatorcontrib>Attouch, H ; Chbani, Z</creatorcontrib><description>In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$, where $\nabla\Phi$ is the gradient of a convex continuously differentiable function $\Phi: \mathcal H \to \mathbb R$, $\alpha$ is a positive parameter, and $g: [t_0, + \infty[ \rightarrow \mathcal H$ is a "small" perturbation term. In this damped inertial system, the viscous damping coefficient $\frac{\alpha}{t}$ vanishes asymptotically, but not too rapidly. For $\alpha \geq 3$, and $\int_{t_0}^{+\infty} t \|g(t)\| dt &lt; + \infty$, just assuming that the solution set is non empty, we show that any trajectory of the above system satisfies the fast convergence property $\Phi(x(t))- \min_{\mathcal H}\Phi \leq \frac{C}{t^2}$. For $\alpha &gt; 3$, we show that any trajectory converges weakly to a minimizer of $\Phi$, and we show the strong convergence property in various practical situations. This complements the results obtained by Su-Boyd- Cand\`es, and Attouch-Peypouquet-Redont, in the unperturbed case $g=0$. The parallel study of the time discretized version of this system provides new insight on the effect of errors, or perturbations on Nesterov's type algorithms. We obtain fast convergence of the values, and convergence of the trajectories for a perturbed version of the variant of FISTA recently considered by Chambolle-Dossal, and Su-Boyd-Cand\`es.</description><identifier>DOI: 10.48550/arxiv.1507.01367</identifier><language>eng</language><subject>Mathematics - Optimization and Control</subject><creationdate>2015-07</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,777,882</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1507.01367$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1507.01367$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Attouch, H</creatorcontrib><creatorcontrib>Chbani, Z</creatorcontrib><title>Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects</title><description>In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$, where $\nabla\Phi$ is the gradient of a convex continuously differentiable function $\Phi: \mathcal H \to \mathbb R$, $\alpha$ is a positive parameter, and $g: [t_0, + \infty[ \rightarrow \mathcal H$ is a "small" perturbation term. In this damped inertial system, the viscous damping coefficient $\frac{\alpha}{t}$ vanishes asymptotically, but not too rapidly. For $\alpha \geq 3$, and $\int_{t_0}^{+\infty} t \|g(t)\| dt &lt; + \infty$, just assuming that the solution set is non empty, we show that any trajectory of the above system satisfies the fast convergence property $\Phi(x(t))- \min_{\mathcal H}\Phi \leq \frac{C}{t^2}$. For $\alpha &gt; 3$, we show that any trajectory converges weakly to a minimizer of $\Phi$, and we show the strong convergence property in various practical situations. This complements the results obtained by Su-Boyd- Cand\`es, and Attouch-Peypouquet-Redont, in the unperturbed case $g=0$. The parallel study of the time discretized version of this system provides new insight on the effect of errors, or perturbations on Nesterov's type algorithms. We obtain fast convergence of the values, and convergence of the trajectories for a perturbed version of the variant of FISTA recently considered by Chambolle-Dossal, and Su-Boyd-Cand\`es.</description><subject>Mathematics - Optimization and Control</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81Kw0AUhWfjQqoP4Mp5gcT5aXrjshSjhYIFs3AX7kzu6ED-mBlL69Mbo4vD4cA5Bz7G7qTI12VRiAcMZ3_KZSEgF1Jv4Jq9VxgT9wOF5LHj7WXA3tvIcWh5tX-rtxy7jzH49NnHucbtOJzozMcp-d5_Y_LjkPPjvP4KZkkc40Q2xRt25bCLdPvvK1ZXT_XuJTu8Pu9320OGG4CsJWXXSoJxVhqE0skSwCihpaWCSmOV1lA44VoioQ2QeHTOajWLCCXoFbv_u13Qmin4HsOl-UVsFkT9A4EkTgg</recordid><startdate>20150706</startdate><enddate>20150706</enddate><creator>Attouch, H</creator><creator>Chbani, Z</creator><scope>AKZ</scope><scope>GOX</scope></search><sort><creationdate>20150706</creationdate><title>Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects</title><author>Attouch, H ; Chbani, Z</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-de2c4217bfc1ba78f1877b2031ce5e8bc23375f0fdee03b7e09ffc32fc3eea173</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Mathematics - Optimization and Control</topic><toplevel>online_resources</toplevel><creatorcontrib>Attouch, H</creatorcontrib><creatorcontrib>Chbani, Z</creatorcontrib><collection>arXiv Mathematics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Attouch, H</au><au>Chbani, Z</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects</atitle><date>2015-07-06</date><risdate>2015</risdate><abstract>In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$, where $\nabla\Phi$ is the gradient of a convex continuously differentiable function $\Phi: \mathcal H \to \mathbb R$, $\alpha$ is a positive parameter, and $g: [t_0, + \infty[ \rightarrow \mathcal H$ is a "small" perturbation term. In this damped inertial system, the viscous damping coefficient $\frac{\alpha}{t}$ vanishes asymptotically, but not too rapidly. For $\alpha \geq 3$, and $\int_{t_0}^{+\infty} t \|g(t)\| dt &lt; + \infty$, just assuming that the solution set is non empty, we show that any trajectory of the above system satisfies the fast convergence property $\Phi(x(t))- \min_{\mathcal H}\Phi \leq \frac{C}{t^2}$. For $\alpha &gt; 3$, we show that any trajectory converges weakly to a minimizer of $\Phi$, and we show the strong convergence property in various practical situations. This complements the results obtained by Su-Boyd- Cand\`es, and Attouch-Peypouquet-Redont, in the unperturbed case $g=0$. The parallel study of the time discretized version of this system provides new insight on the effect of errors, or perturbations on Nesterov's type algorithms. We obtain fast convergence of the values, and convergence of the trajectories for a perturbed version of the variant of FISTA recently considered by Chambolle-Dossal, and Su-Boyd-Cand\`es.</abstract><doi>10.48550/arxiv.1507.01367</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1507.01367
ispartof
issn
language eng
recordid cdi_arxiv_primary_1507_01367
source arXiv.org
subjects Mathematics - Optimization and Control
title Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T17%3A04%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Fast%20inertial%20dynamics%20and%20FISTA%20algorithms%20in%20convex%20optimization.%20Perturbation%20aspects&rft.au=Attouch,%20H&rft.date=2015-07-06&rft_id=info:doi/10.48550/arxiv.1507.01367&rft_dat=%3Carxiv_GOX%3E1507_01367%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true