A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems

•Novel multiple shooting algorithm for PDE optimal control problems.•Use of augmented Lagrangian method for equality constrained optimization.•Efficiency strongly depends on initial guess for matching conditions.•Efficiency strongly depends on proper scaling of gradients in AL subproblems.•Significa...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of computational physics 2022-03, Vol.452, p.110926, Article 110926
Hauptverfasser: Fang, Liang, Vandewalle, Stefan, Meyers, Johan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 110926
container_title Journal of computational physics
container_volume 452
creator Fang, Liang
Vandewalle, Stefan
Meyers, Johan
description •Novel multiple shooting algorithm for PDE optimal control problems.•Use of augmented Lagrangian method for equality constrained optimization.•Efficiency strongly depends on initial guess for matching conditions.•Efficiency strongly depends on proper scaling of gradients in AL subproblems.•Significant algorithmic speed-ups for up to 50 shooting windows. Multiple shooting methods for solving optimal control problems governed by ODEs have been extensively studied in past decades. However, their application for solving large-scale PDE-based optimal control problems still faces many challenges, including the difficulty of solving large scale equality constrained optimization problems in an efficient parallelizable way. The current work proposes and analyzes a new parallel-in-time multiple shooting algorithm for large scale optimal control problems governed by parabolic PDEs. We solve the equality constrained optimization problems introduced by the multiple shooting strategy by using the augmented Lagrangian method, in which the unconstrained subproblems are solved using a classical limited-memory BFGS quasi-Newton method. An optimal control problem governed by the Nagumo equation is employed to validate the proposed algorithm and analyze its efficiency. The results demonstrate that substantial accelerations can be achieved for multiple shooting approaches when proper starting guesses of controls are provided, and when the control variables are scaled appropriately. A second test case consists of a two-dimensional velocity tracking problem that is governed by the Navier–Stokes equations. The influence of the flow complexity on the optimization method is studied, and the results illustrate that for a fluid field with more complex structures, the efficiency of the algorithm further increases. Overall, for the different cases considered, we find algorithmic speed-ups of up to 6 versus single shooting, depending on the starting guess, and the specific tracking problem.
doi_str_mv 10.1016/j.jcp.2021.110926
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2639728932</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0021999121008214</els_id><sourcerecordid>2639728932</sourcerecordid><originalsourceid>FETCH-LOGICAL-c368t-481837125954fa810cd92e021d5fe6d4b1421662fc55daca6f12a2a522cbb1663</originalsourceid><addsrcrecordid>eNp9UE1LwzAYDqLgnP4AbwHPqUnaZi2expwfMNCDnkOavu1SsqYmmeC_N6OePT3wvs8XD0K3jGaMMnE_ZIOeMk45yxijNRdnaJGQEr5i4hwtaPqQuq7ZJboKYaCUVmVRLVC_xpPyylqwxIwkmgPgw9FGM1nAYe9cNGOPle2dN3F_wJ3z2CrfAwlaJcr745ZoN4bolRmhxW5KFsridIveWTx511g4hGt00Skb4OYPl-jzafuxeSG7t-fXzXpHdC6qSIqKVfmK8bIui05VjOq25pC6t2UHoi0aVnAmBO90WbZKK9ExrrgqOddNkx75Et3Nvin46wghysEd_ZgiJRd5veJVnfPEYjNLexeCh05OPtX2P5JRedpTDjLtKU97ynnPpHmYNZDqfxvwMmgDo4bWeNBRts78o_4F3wV-Ag</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2639728932</pqid></control><display><type>article</type><title>A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems</title><source>Elsevier ScienceDirect Journals</source><creator>Fang, Liang ; Vandewalle, Stefan ; Meyers, Johan</creator><creatorcontrib>Fang, Liang ; Vandewalle, Stefan ; Meyers, Johan</creatorcontrib><description>•Novel multiple shooting algorithm for PDE optimal control problems.•Use of augmented Lagrangian method for equality constrained optimization.•Efficiency strongly depends on initial guess for matching conditions.•Efficiency strongly depends on proper scaling of gradients in AL subproblems.•Significant algorithmic speed-ups for up to 50 shooting windows. Multiple shooting methods for solving optimal control problems governed by ODEs have been extensively studied in past decades. However, their application for solving large-scale PDE-based optimal control problems still faces many challenges, including the difficulty of solving large scale equality constrained optimization problems in an efficient parallelizable way. The current work proposes and analyzes a new parallel-in-time multiple shooting algorithm for large scale optimal control problems governed by parabolic PDEs. We solve the equality constrained optimization problems introduced by the multiple shooting strategy by using the augmented Lagrangian method, in which the unconstrained subproblems are solved using a classical limited-memory BFGS quasi-Newton method. An optimal control problem governed by the Nagumo equation is employed to validate the proposed algorithm and analyze its efficiency. The results demonstrate that substantial accelerations can be achieved for multiple shooting approaches when proper starting guesses of controls are provided, and when the control variables are scaled appropriately. A second test case consists of a two-dimensional velocity tracking problem that is governed by the Navier–Stokes equations. The influence of the flow complexity on the optimization method is studied, and the results illustrate that for a fluid field with more complex structures, the efficiency of the algorithm further increases. Overall, for the different cases considered, we find algorithmic speed-ups of up to 6 versus single shooting, depending on the starting guess, and the specific tracking problem.</description><identifier>ISSN: 0021-9991</identifier><identifier>EISSN: 1090-2716</identifier><identifier>DOI: 10.1016/j.jcp.2021.110926</identifier><language>eng</language><publisher>Cambridge: Elsevier Inc</publisher><subject>Algorithms ; Augmented Lagrangian method ; Complexity ; Computational physics ; Multiple shooting ; Optimal control ; Optimization ; Parabolic differential equations ; Partial differential equations ; PDE-constrained optimization ; Quasi Newton methods ; Shooting algorithms ; Tracking problem</subject><ispartof>Journal of computational physics, 2022-03, Vol.452, p.110926, Article 110926</ispartof><rights>2021 Elsevier Inc.</rights><rights>Copyright Elsevier Science Ltd. Mar 1, 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c368t-481837125954fa810cd92e021d5fe6d4b1421662fc55daca6f12a2a522cbb1663</citedby><cites>FETCH-LOGICAL-c368t-481837125954fa810cd92e021d5fe6d4b1421662fc55daca6f12a2a522cbb1663</cites><orcidid>0000-0002-2828-4397 ; 0000-0002-8988-2374 ; 0000-0002-7890-2616</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.jcp.2021.110926$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,777,781,3537,27905,27906,45976</link.rule.ids></links><search><creatorcontrib>Fang, Liang</creatorcontrib><creatorcontrib>Vandewalle, Stefan</creatorcontrib><creatorcontrib>Meyers, Johan</creatorcontrib><title>A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems</title><title>Journal of computational physics</title><description>•Novel multiple shooting algorithm for PDE optimal control problems.•Use of augmented Lagrangian method for equality constrained optimization.•Efficiency strongly depends on initial guess for matching conditions.•Efficiency strongly depends on proper scaling of gradients in AL subproblems.•Significant algorithmic speed-ups for up to 50 shooting windows. Multiple shooting methods for solving optimal control problems governed by ODEs have been extensively studied in past decades. However, their application for solving large-scale PDE-based optimal control problems still faces many challenges, including the difficulty of solving large scale equality constrained optimization problems in an efficient parallelizable way. The current work proposes and analyzes a new parallel-in-time multiple shooting algorithm for large scale optimal control problems governed by parabolic PDEs. We solve the equality constrained optimization problems introduced by the multiple shooting strategy by using the augmented Lagrangian method, in which the unconstrained subproblems are solved using a classical limited-memory BFGS quasi-Newton method. An optimal control problem governed by the Nagumo equation is employed to validate the proposed algorithm and analyze its efficiency. The results demonstrate that substantial accelerations can be achieved for multiple shooting approaches when proper starting guesses of controls are provided, and when the control variables are scaled appropriately. A second test case consists of a two-dimensional velocity tracking problem that is governed by the Navier–Stokes equations. The influence of the flow complexity on the optimization method is studied, and the results illustrate that for a fluid field with more complex structures, the efficiency of the algorithm further increases. Overall, for the different cases considered, we find algorithmic speed-ups of up to 6 versus single shooting, depending on the starting guess, and the specific tracking problem.</description><subject>Algorithms</subject><subject>Augmented Lagrangian method</subject><subject>Complexity</subject><subject>Computational physics</subject><subject>Multiple shooting</subject><subject>Optimal control</subject><subject>Optimization</subject><subject>Parabolic differential equations</subject><subject>Partial differential equations</subject><subject>PDE-constrained optimization</subject><subject>Quasi Newton methods</subject><subject>Shooting algorithms</subject><subject>Tracking problem</subject><issn>0021-9991</issn><issn>1090-2716</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LwzAYDqLgnP4AbwHPqUnaZi2expwfMNCDnkOavu1SsqYmmeC_N6OePT3wvs8XD0K3jGaMMnE_ZIOeMk45yxijNRdnaJGQEr5i4hwtaPqQuq7ZJboKYaCUVmVRLVC_xpPyylqwxIwkmgPgw9FGM1nAYe9cNGOPle2dN3F_wJ3z2CrfAwlaJcr745ZoN4bolRmhxW5KFsridIveWTx511g4hGt00Skb4OYPl-jzafuxeSG7t-fXzXpHdC6qSIqKVfmK8bIui05VjOq25pC6t2UHoi0aVnAmBO90WbZKK9ExrrgqOddNkx75Et3Nvin46wghysEd_ZgiJRd5veJVnfPEYjNLexeCh05OPtX2P5JRedpTDjLtKU97ynnPpHmYNZDqfxvwMmgDo4bWeNBRts78o_4F3wV-Ag</recordid><startdate>20220301</startdate><enddate>20220301</enddate><creator>Fang, Liang</creator><creator>Vandewalle, Stefan</creator><creator>Meyers, Johan</creator><general>Elsevier Inc</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2828-4397</orcidid><orcidid>https://orcid.org/0000-0002-8988-2374</orcidid><orcidid>https://orcid.org/0000-0002-7890-2616</orcidid></search><sort><creationdate>20220301</creationdate><title>A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems</title><author>Fang, Liang ; Vandewalle, Stefan ; Meyers, Johan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c368t-481837125954fa810cd92e021d5fe6d4b1421662fc55daca6f12a2a522cbb1663</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Augmented Lagrangian method</topic><topic>Complexity</topic><topic>Computational physics</topic><topic>Multiple shooting</topic><topic>Optimal control</topic><topic>Optimization</topic><topic>Parabolic differential equations</topic><topic>Partial differential equations</topic><topic>PDE-constrained optimization</topic><topic>Quasi Newton methods</topic><topic>Shooting algorithms</topic><topic>Tracking problem</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fang, Liang</creatorcontrib><creatorcontrib>Vandewalle, Stefan</creatorcontrib><creatorcontrib>Meyers, Johan</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Journal of computational physics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fang, Liang</au><au>Vandewalle, Stefan</au><au>Meyers, Johan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems</atitle><jtitle>Journal of computational physics</jtitle><date>2022-03-01</date><risdate>2022</risdate><volume>452</volume><spage>110926</spage><pages>110926-</pages><artnum>110926</artnum><issn>0021-9991</issn><eissn>1090-2716</eissn><abstract>•Novel multiple shooting algorithm for PDE optimal control problems.•Use of augmented Lagrangian method for equality constrained optimization.•Efficiency strongly depends on initial guess for matching conditions.•Efficiency strongly depends on proper scaling of gradients in AL subproblems.•Significant algorithmic speed-ups for up to 50 shooting windows. Multiple shooting methods for solving optimal control problems governed by ODEs have been extensively studied in past decades. However, their application for solving large-scale PDE-based optimal control problems still faces many challenges, including the difficulty of solving large scale equality constrained optimization problems in an efficient parallelizable way. The current work proposes and analyzes a new parallel-in-time multiple shooting algorithm for large scale optimal control problems governed by parabolic PDEs. We solve the equality constrained optimization problems introduced by the multiple shooting strategy by using the augmented Lagrangian method, in which the unconstrained subproblems are solved using a classical limited-memory BFGS quasi-Newton method. An optimal control problem governed by the Nagumo equation is employed to validate the proposed algorithm and analyze its efficiency. The results demonstrate that substantial accelerations can be achieved for multiple shooting approaches when proper starting guesses of controls are provided, and when the control variables are scaled appropriately. A second test case consists of a two-dimensional velocity tracking problem that is governed by the Navier–Stokes equations. The influence of the flow complexity on the optimization method is studied, and the results illustrate that for a fluid field with more complex structures, the efficiency of the algorithm further increases. Overall, for the different cases considered, we find algorithmic speed-ups of up to 6 versus single shooting, depending on the starting guess, and the specific tracking problem.</abstract><cop>Cambridge</cop><pub>Elsevier Inc</pub><doi>10.1016/j.jcp.2021.110926</doi><orcidid>https://orcid.org/0000-0002-2828-4397</orcidid><orcidid>https://orcid.org/0000-0002-8988-2374</orcidid><orcidid>https://orcid.org/0000-0002-7890-2616</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0021-9991
ispartof Journal of computational physics, 2022-03, Vol.452, p.110926, Article 110926
issn 0021-9991
1090-2716
language eng
recordid cdi_proquest_journals_2639728932
source Elsevier ScienceDirect Journals
subjects Algorithms
Augmented Lagrangian method
Complexity
Computational physics
Multiple shooting
Optimal control
Optimization
Parabolic differential equations
Partial differential equations
PDE-constrained optimization
Quasi Newton methods
Shooting algorithms
Tracking problem
title A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T02%3A17%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20parallel-in-time%20multiple%20shooting%20algorithm%20for%20large-scale%20PDE-constrained%20optimal%20control%20problems&rft.jtitle=Journal%20of%20computational%20physics&rft.au=Fang,%20Liang&rft.date=2022-03-01&rft.volume=452&rft.spage=110926&rft.pages=110926-&rft.artnum=110926&rft.issn=0021-9991&rft.eissn=1090-2716&rft_id=info:doi/10.1016/j.jcp.2021.110926&rft_dat=%3Cproquest_cross%3E2639728932%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2639728932&rft_id=info:pmid/&rft_els_id=S0021999121008214&rfr_iscdi=true