Faster Model Predictive Control via Self-Supervised Initialization Learning

Optimization for robot control tasks, spanning various methodologies, includes Model Predictive Control (MPC). However, the complexity of the system, such as non-convex and non-differentiable cost functions and prolonged planning horizons often drastically increases the computation time, limiting MP...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Zhaoxin, Chen, Letian, Paleja, Rohan, Nageshrao, Subramanya, Gombolay, Matthew
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Li, Zhaoxin
Chen, Letian
Paleja, Rohan
Nageshrao, Subramanya
Gombolay, Matthew
description Optimization for robot control tasks, spanning various methodologies, includes Model Predictive Control (MPC). However, the complexity of the system, such as non-convex and non-differentiable cost functions and prolonged planning horizons often drastically increases the computation time, limiting MPC's real-world applicability. Prior works in speeding up the optimization have limitations on solving convex problem and generalizing to hold out domains. To overcome this challenge, we develop a novel framework aiming at expediting optimization processes. In our framework, we combine offline self-supervised learning and online fine-tuning through reinforcement learning to improve the control performance and reduce optimization time. We demonstrate the effectiveness of our method on a novel, challenging Formula-1-track driving task, achieving 3.9\% higher performance in optimization time and 3.6\% higher performance in tracking accuracy on challenging holdout tracks.
doi_str_mv 10.48550/arxiv.2408.03394
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2408_03394</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2408_03394</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2408_033943</originalsourceid><addsrcrecordid>eNqFzbEKwjAQgOEsDqI-gJP3Aq3RtlDnYlFUEOpeDnuVg5iUawzq04vF3elffviUmq90nOZZppcoTw7xOtV5rJNkk47VocTek8DJNWTgLNTw1XMgKJz14gwERqjItFH16EgC99TA3rJnNPxGz87CkVAs29tUjVo0Pc1-nahFub0Uu2hg6074jvKqv3w98Mn_4wPMfTsh</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Faster Model Predictive Control via Self-Supervised Initialization Learning</title><source>arXiv.org</source><creator>Li, Zhaoxin ; Chen, Letian ; Paleja, Rohan ; Nageshrao, Subramanya ; Gombolay, Matthew</creator><creatorcontrib>Li, Zhaoxin ; Chen, Letian ; Paleja, Rohan ; Nageshrao, Subramanya ; Gombolay, Matthew</creatorcontrib><description>Optimization for robot control tasks, spanning various methodologies, includes Model Predictive Control (MPC). However, the complexity of the system, such as non-convex and non-differentiable cost functions and prolonged planning horizons often drastically increases the computation time, limiting MPC's real-world applicability. Prior works in speeding up the optimization have limitations on solving convex problem and generalizing to hold out domains. To overcome this challenge, we develop a novel framework aiming at expediting optimization processes. In our framework, we combine offline self-supervised learning and online fine-tuning through reinforcement learning to improve the control performance and reduce optimization time. We demonstrate the effectiveness of our method on a novel, challenging Formula-1-track driving task, achieving 3.9\% higher performance in optimization time and 3.6\% higher performance in tracking accuracy on challenging holdout tracks.</description><identifier>DOI: 10.48550/arxiv.2408.03394</identifier><language>eng</language><subject>Computer Science - Robotics</subject><creationdate>2024-08</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,781,886</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2408.03394$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2408.03394$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Li, Zhaoxin</creatorcontrib><creatorcontrib>Chen, Letian</creatorcontrib><creatorcontrib>Paleja, Rohan</creatorcontrib><creatorcontrib>Nageshrao, Subramanya</creatorcontrib><creatorcontrib>Gombolay, Matthew</creatorcontrib><title>Faster Model Predictive Control via Self-Supervised Initialization Learning</title><description>Optimization for robot control tasks, spanning various methodologies, includes Model Predictive Control (MPC). However, the complexity of the system, such as non-convex and non-differentiable cost functions and prolonged planning horizons often drastically increases the computation time, limiting MPC's real-world applicability. Prior works in speeding up the optimization have limitations on solving convex problem and generalizing to hold out domains. To overcome this challenge, we develop a novel framework aiming at expediting optimization processes. In our framework, we combine offline self-supervised learning and online fine-tuning through reinforcement learning to improve the control performance and reduce optimization time. We demonstrate the effectiveness of our method on a novel, challenging Formula-1-track driving task, achieving 3.9\% higher performance in optimization time and 3.6\% higher performance in tracking accuracy on challenging holdout tracks.</description><subject>Computer Science - Robotics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFzbEKwjAQgOEsDqI-gJP3Aq3RtlDnYlFUEOpeDnuVg5iUawzq04vF3elffviUmq90nOZZppcoTw7xOtV5rJNkk47VocTek8DJNWTgLNTw1XMgKJz14gwERqjItFH16EgC99TA3rJnNPxGz87CkVAs29tUjVo0Pc1-nahFub0Uu2hg6074jvKqv3w98Mn_4wPMfTsh</recordid><startdate>20240806</startdate><enddate>20240806</enddate><creator>Li, Zhaoxin</creator><creator>Chen, Letian</creator><creator>Paleja, Rohan</creator><creator>Nageshrao, Subramanya</creator><creator>Gombolay, Matthew</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240806</creationdate><title>Faster Model Predictive Control via Self-Supervised Initialization Learning</title><author>Li, Zhaoxin ; Chen, Letian ; Paleja, Rohan ; Nageshrao, Subramanya ; Gombolay, Matthew</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2408_033943</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Robotics</topic><toplevel>online_resources</toplevel><creatorcontrib>Li, Zhaoxin</creatorcontrib><creatorcontrib>Chen, Letian</creatorcontrib><creatorcontrib>Paleja, Rohan</creatorcontrib><creatorcontrib>Nageshrao, Subramanya</creatorcontrib><creatorcontrib>Gombolay, Matthew</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Li, Zhaoxin</au><au>Chen, Letian</au><au>Paleja, Rohan</au><au>Nageshrao, Subramanya</au><au>Gombolay, Matthew</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Faster Model Predictive Control via Self-Supervised Initialization Learning</atitle><date>2024-08-06</date><risdate>2024</risdate><abstract>Optimization for robot control tasks, spanning various methodologies, includes Model Predictive Control (MPC). However, the complexity of the system, such as non-convex and non-differentiable cost functions and prolonged planning horizons often drastically increases the computation time, limiting MPC's real-world applicability. Prior works in speeding up the optimization have limitations on solving convex problem and generalizing to hold out domains. To overcome this challenge, we develop a novel framework aiming at expediting optimization processes. In our framework, we combine offline self-supervised learning and online fine-tuning through reinforcement learning to improve the control performance and reduce optimization time. We demonstrate the effectiveness of our method on a novel, challenging Formula-1-track driving task, achieving 3.9\% higher performance in optimization time and 3.6\% higher performance in tracking accuracy on challenging holdout tracks.</abstract><doi>10.48550/arxiv.2408.03394</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2408.03394
ispartof
issn
language eng
recordid cdi_arxiv_primary_2408_03394
source arXiv.org
subjects Computer Science - Robotics
title Faster Model Predictive Control via Self-Supervised Initialization Learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-12T02%3A10%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Faster%20Model%20Predictive%20Control%20via%20Self-Supervised%20Initialization%20Learning&rft.au=Li,%20Zhaoxin&rft.date=2024-08-06&rft_id=info:doi/10.48550/arxiv.2408.03394&rft_dat=%3Carxiv_GOX%3E2408_03394%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true