Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints
In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a linearized augmented Lagrangian method, i.e., we linearize the functi...
Gespeichert in:
Hauptverfasser: | , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Bourkhissi, Lahcen El Necoara, Ion |
description | In this paper, we consider a nonconvex optimization problem with nonlinear
equality constraints. We assume that both, the objective function and the
functional constraints are locally smooth. For solving this problem, we propose
a linearized augmented Lagrangian method, i.e., we linearize the functional
constraints in the augmented Lagrangian at the current iterate and add a
quadratic regularization, yielding a subproblem that is easy to solve, and
whose solution is the next iterate. Under a dynamic regularization parameter
choice, we prove global asymptotic convergence of the iterates to a critical
point of the problem. We also derive convergence guarantees for the iterates of
our method to an $\epsilon$ first-order optimal solution in
$\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the
problem data are e.g., semialgebraic, the sequence generated by our algorithm
converges and we derive convergence rates. We validate the theory and the
performance of the proposed algorithm by numerically comparing it with the
existing methods from the literature. |
doi_str_mv | 10.48550/arxiv.2301.08345 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2301_08345</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2301_08345</sourcerecordid><originalsourceid>FETCH-LOGICAL-a675-421a8db28bf3564c04ee677ccacc4982ef5bcdf9d11da1a27e27925757ff0cce3</originalsourceid><addsrcrecordid>eNotj71OwzAURr0woMIDMNUvkGA7dpyMKOJPisTSPbpxroOlxA6OC22fHtoyfWf5jnQIeeAsl5VS7BHiwX3nomA8Z1Uh1S3pmzAvEx5cOtJg6eQ8QnQnHCjsxxl9-qMWxgh-dOCpDZGGJbnZnSC54OmPS5_UB389Uvzaw3R2meDXFMH5tN6RGwvTivf_uyG7l-dd85a1H6_vzVObQalVJgWHauhF1dtCldIwiVhqbQwYI-tKoFW9GWw9cD4AB6FR6FoorbS1zBgsNmR71V4iuyW6GeKxO8d2l9jiFyThUwM</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><source>arXiv.org</source><creator>Bourkhissi, Lahcen El ; Necoara, Ion</creator><creatorcontrib>Bourkhissi, Lahcen El ; Necoara, Ion</creatorcontrib><description>In this paper, we consider a nonconvex optimization problem with nonlinear
equality constraints. We assume that both, the objective function and the
functional constraints are locally smooth. For solving this problem, we propose
a linearized augmented Lagrangian method, i.e., we linearize the functional
constraints in the augmented Lagrangian at the current iterate and add a
quadratic regularization, yielding a subproblem that is easy to solve, and
whose solution is the next iterate. Under a dynamic regularization parameter
choice, we prove global asymptotic convergence of the iterates to a critical
point of the problem. We also derive convergence guarantees for the iterates of
our method to an $\epsilon$ first-order optimal solution in
$\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the
problem data are e.g., semialgebraic, the sequence generated by our algorithm
converges and we derive convergence rates. We validate the theory and the
performance of the proposed algorithm by numerically comparing it with the
existing methods from the literature.</description><identifier>DOI: 10.48550/arxiv.2301.08345</identifier><language>eng</language><subject>Mathematics - Optimization and Control</subject><creationdate>2023-01</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2301.08345$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2301.08345$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Bourkhissi, Lahcen El</creatorcontrib><creatorcontrib>Necoara, Ion</creatorcontrib><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><description>In this paper, we consider a nonconvex optimization problem with nonlinear
equality constraints. We assume that both, the objective function and the
functional constraints are locally smooth. For solving this problem, we propose
a linearized augmented Lagrangian method, i.e., we linearize the functional
constraints in the augmented Lagrangian at the current iterate and add a
quadratic regularization, yielding a subproblem that is easy to solve, and
whose solution is the next iterate. Under a dynamic regularization parameter
choice, we prove global asymptotic convergence of the iterates to a critical
point of the problem. We also derive convergence guarantees for the iterates of
our method to an $\epsilon$ first-order optimal solution in
$\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the
problem data are e.g., semialgebraic, the sequence generated by our algorithm
converges and we derive convergence rates. We validate the theory and the
performance of the proposed algorithm by numerically comparing it with the
existing methods from the literature.</description><subject>Mathematics - Optimization and Control</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr0woMIDMNUvkGA7dpyMKOJPisTSPbpxroOlxA6OC22fHtoyfWf5jnQIeeAsl5VS7BHiwX3nomA8Z1Uh1S3pmzAvEx5cOtJg6eQ8QnQnHCjsxxl9-qMWxgh-dOCpDZGGJbnZnSC54OmPS5_UB389Uvzaw3R2meDXFMH5tN6RGwvTivf_uyG7l-dd85a1H6_vzVObQalVJgWHauhF1dtCldIwiVhqbQwYI-tKoFW9GWw9cD4AB6FR6FoorbS1zBgsNmR71V4iuyW6GeKxO8d2l9jiFyThUwM</recordid><startdate>20230119</startdate><enddate>20230119</enddate><creator>Bourkhissi, Lahcen El</creator><creator>Necoara, Ion</creator><scope>AKZ</scope><scope>GOX</scope></search><sort><creationdate>20230119</creationdate><title>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</title><author>Bourkhissi, Lahcen El ; Necoara, Ion</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a675-421a8db28bf3564c04ee677ccacc4982ef5bcdf9d11da1a27e27925757ff0cce3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Mathematics - Optimization and Control</topic><toplevel>online_resources</toplevel><creatorcontrib>Bourkhissi, Lahcen El</creatorcontrib><creatorcontrib>Necoara, Ion</creatorcontrib><collection>arXiv Mathematics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Bourkhissi, Lahcen El</au><au>Necoara, Ion</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints</atitle><date>2023-01-19</date><risdate>2023</risdate><abstract>In this paper, we consider a nonconvex optimization problem with nonlinear
equality constraints. We assume that both, the objective function and the
functional constraints are locally smooth. For solving this problem, we propose
a linearized augmented Lagrangian method, i.e., we linearize the functional
constraints in the augmented Lagrangian at the current iterate and add a
quadratic regularization, yielding a subproblem that is easy to solve, and
whose solution is the next iterate. Under a dynamic regularization parameter
choice, we prove global asymptotic convergence of the iterates to a critical
point of the problem. We also derive convergence guarantees for the iterates of
our method to an $\epsilon$ first-order optimal solution in
$\mathcal{O}(1/{\epsilon^2})$ outer iterations. Finally, we show that, when the
problem data are e.g., semialgebraic, the sequence generated by our algorithm
converges and we derive convergence rates. We validate the theory and the
performance of the proposed algorithm by numerically comparing it with the
existing methods from the literature.</abstract><doi>10.48550/arxiv.2301.08345</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2301.08345 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2301_08345 |
source | arXiv.org |
subjects | Mathematics - Optimization and Control |
title | Complexity of linearized augmented Lagrangian for optimization with nonlinear equality constraints |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T15%3A23%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Complexity%20of%20linearized%20augmented%20Lagrangian%20for%20optimization%20with%20nonlinear%20equality%20constraints&rft.au=Bourkhissi,%20Lahcen%20El&rft.date=2023-01-19&rft_id=info:doi/10.48550/arxiv.2301.08345&rft_dat=%3Carxiv_GOX%3E2301_08345%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |