Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bourkhissi, Lahcen El, Necoara, Ion
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Bourkhissi, Lahcen El
Necoara, Ion
description In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functional constraints in the augmented Lagrangian at the current iterate and add a quadratic regularization, yielding a subproblem that is easy to solve, and whose solution is the next iterate. Under a dynamic regularization parameter choice, we prove global asymptotic convergence of the iterates to a critical point of the problem. We also derive convergence guarantees for the iterates of our method to an $\epsilon$ first-order optimal solution in $\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the problem data are e.g., semialgebraic, the sequence generated by our algorithm converges and we derive convergence rates. We validate the theory and the performance of the proposed algorithm by numerically comparing it with the existing methods from the literature.
doi_str_mv 10.48550/arxiv.2301.08345
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2301_08345</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2301_08345</sourcerecordid><originalsourceid>FETCH-LOGICAL-a675-421a8db28bf3564c04ee677ccacc4982ef5bcdf9d11da1a27e27925757ff0cce3</originalsourceid><addsrcrecordid>eNotj71OwzAURr0woMIDMNUvkGA7dpyMKOJPisTSPbpxroOlxA6OC22fHtoyfWf5jnQIeeAsl5VS7BHiwX3nomA8Z1Uh1S3pmzAvEx5cOtJg6eQ8QnQnHCjsxxl9-qMWxgh-dOCpDZGGJbnZnSC54OmPS5_UB389Uvzaw3R2meDXFMH5tN6RGwvTivf_uyG7l-dd85a1H6_vzVObQalVJgWHauhF1dtCldIwiVhqbQwYI-tKoFW9GWw9cD4AB6FR6FoorbS1zBgsNmR71V4iuyW6GeKxO8d2l9jiFyThUwM</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><source>arXiv.org</source><creator>Bourkhissi, Lahcen El ; Necoara, Ion</creator><creatorcontrib>Bourkhissi, Lahcen El ; Necoara, Ion</creatorcontrib><description>In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functional constraints in the augmented Lagrangian at the current iterate and add a quadratic regularization, yielding a subproblem that is easy to solve, and whose solution is the next iterate. Under a dynamic regularization parameter choice, we prove global asymptotic convergence of the iterates to a critical point of the problem. We also derive convergence guarantees for the iterates of our method to an $\epsilon$ first-order optimal solution in $\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the problem data are e.g., semialgebraic, the sequence generated by our algorithm converges and we derive convergence rates. We validate the theory and the performance of the proposed algorithm by numerically comparing it with the existing methods from the literature.</description><identifier>DOI: 10.48550/arxiv.2301.08345</identifier><language>eng</language><subject>Mathematics - Optimization and Control</subject><creationdate>2023-01</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2301.08345$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2301.08345$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Bourkhissi, Lahcen El</creatorcontrib><creatorcontrib>Necoara, Ion</creatorcontrib><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><description>In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functional constraints in the augmented Lagrangian at the current iterate and add a quadratic regularization, yielding a subproblem that is easy to solve, and whose solution is the next iterate. Under a dynamic regularization parameter choice, we prove global asymptotic convergence of the iterates to a critical point of the problem. We also derive convergence guarantees for the iterates of our method to an $\epsilon$ first-order optimal solution in $\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the problem data are e.g., semialgebraic, the sequence generated by our algorithm converges and we derive convergence rates. We validate the theory and the performance of the proposed algorithm by numerically comparing it with the existing methods from the literature.</description><subject>Mathematics - Optimization and Control</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr0woMIDMNUvkGA7dpyMKOJPisTSPbpxroOlxA6OC22fHtoyfWf5jnQIeeAsl5VS7BHiwX3nomA8Z1Uh1S3pmzAvEx5cOtJg6eQ8QnQnHCjsxxl9-qMWxgh-dOCpDZGGJbnZnSC54OmPS5_UB389Uvzaw3R2meDXFMH5tN6RGwvTivf_uyG7l-dd85a1H6_vzVObQalVJgWHauhF1dtCldIwiVhqbQwYI-tKoFW9GWw9cD4AB6FR6FoorbS1zBgsNmR71V4iuyW6GeKxO8d2l9jiFyThUwM</recordid><startdate>20230119</startdate><enddate>20230119</enddate><creator>Bourkhissi, Lahcen El</creator><creator>Necoara, Ion</creator><scope>AKZ</scope><scope>GOX</scope></search><sort><creationdate>20230119</creationdate><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><author>Bourkhissi, Lahcen El ; Necoara, Ion</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a675-421a8db28bf3564c04ee677ccacc4982ef5bcdf9d11da1a27e27925757ff0cce3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Mathematics - Optimization and Control</topic><toplevel>online_resources</toplevel><creatorcontrib>Bourkhissi, Lahcen El</creatorcontrib><creatorcontrib>Necoara, Ion</creatorcontrib><collection>arXiv Mathematics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Bourkhissi, Lahcen El</au><au>Necoara, Ion</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</atitle><date>2023-01-19</date><risdate>2023</risdate><abstract>In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functional constraints in the augmented Lagrangian at the current iterate and add a quadratic regularization, yielding a subproblem that is easy to solve, and whose solution is the next iterate. Under a dynamic regularization parameter choice, we prove global asymptotic convergence of the iterates to a critical point of the problem. We also derive convergence guarantees for the iterates of our method to an $\epsilon$ first-order optimal solution in $\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the problem data are e.g., semialgebraic, the sequence generated by our algorithm converges and we derive convergence rates. We validate the theory and the performance of the proposed algorithm by numerically comparing it with the existing methods from the literature.</abstract><doi>10.48550/arxiv.2301.08345</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2301.08345
ispartof
issn
language eng
recordid cdi_arxiv_primary_2301_08345
source arXiv.org
subjects Mathematics - Optimization and Control
title Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T15%3A23%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Complexity%20of%20linearized%20augmented%20Lagrangian%20for%20optimization%20with%20nonlinear%20equality%20constraints&rft.au=Bourkhissi,%20Lahcen%20El&rft.date=2023-01-19&rft_id=info:doi/10.48550/arxiv.2301.08345&rft_dat=%3Carxiv_GOX%3E2301_08345%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true