How people initiate energy optimization and converge on their optimal gaits

A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordinat...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of experimental biology 2019-01
Hauptverfasser: Selinger, Jessica C., Wong, Jeremy D., Simha, Surabhi N., Donelan, J. Maxwell
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title Journal of experimental biology
container_volume
creator Selinger, Jessica C.
Wong, Jeremy D.
Simha, Surabhi N.
Donelan, J. Maxwell
description A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.
doi_str_mv 10.1242/jeb.198234
format Article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1242_jeb_198234</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1242_jeb_198234</sourcerecordid><originalsourceid>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</originalsourceid><addsrcrecordid>eNotkE1LxDAQhoMoWFcv_oKcha6Tj6bNURZ1xQUvei7TNFmz1KYkQVl_vV3qXIbhfRkeHkJuGawZl_z-YLs10w0X8owUTNZ1qZmszkkBwHkJWupLcpXSAeZRlSzI6zb80MmGabDUjz57zJba0cb9kYYp-y__i9mHkeLYUxPG7zmxdL7zp_VxqeBA9-hzuiYXDodkb_73inw8Pb5vtuXu7fll87ArDZshS1M7AU6gNZXUHDlrHChTYc91X0HPbA2qgw6kVg2CagwwJVAaQNcbhVysyN3y18SQUrSuneJMEY8tg_akoZ01tIsG8QdhGlDa</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>How people initiate energy optimization and converge on their optimal gaits</title><source>Alma/SFX Local Collection</source><source>EZB Electronic Journals Library</source><source>Company of Biologists</source><creator>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</creator><creatorcontrib>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</creatorcontrib><description>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</description><identifier>ISSN: 0022-0949</identifier><identifier>EISSN: 1477-9145</identifier><identifier>DOI: 10.1242/jeb.198234</identifier><language>eng</language><ispartof>Journal of experimental biology, 2019-01</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</citedby><cites>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</cites><orcidid>0000-0001-9372-6705</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,3665,27901,27902</link.rule.ids></links><search><creatorcontrib>Selinger, Jessica C.</creatorcontrib><creatorcontrib>Wong, Jeremy D.</creatorcontrib><creatorcontrib>Simha, Surabhi N.</creatorcontrib><creatorcontrib>Donelan, J. Maxwell</creatorcontrib><title>How people initiate energy optimization and converge on their optimal gaits</title><title>Journal of experimental biology</title><description>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</description><issn>0022-0949</issn><issn>1477-9145</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNotkE1LxDAQhoMoWFcv_oKcha6Tj6bNURZ1xQUvei7TNFmz1KYkQVl_vV3qXIbhfRkeHkJuGawZl_z-YLs10w0X8owUTNZ1qZmszkkBwHkJWupLcpXSAeZRlSzI6zb80MmGabDUjz57zJba0cb9kYYp-y__i9mHkeLYUxPG7zmxdL7zp_VxqeBA9-hzuiYXDodkb_73inw8Pb5vtuXu7fll87ArDZshS1M7AU6gNZXUHDlrHChTYc91X0HPbA2qgw6kVg2CagwwJVAaQNcbhVysyN3y18SQUrSuneJMEY8tg_akoZ01tIsG8QdhGlDa</recordid><startdate>20190101</startdate><enddate>20190101</enddate><creator>Selinger, Jessica C.</creator><creator>Wong, Jeremy D.</creator><creator>Simha, Surabhi N.</creator><creator>Donelan, J. Maxwell</creator><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-9372-6705</orcidid></search><sort><creationdate>20190101</creationdate><title>How people initiate energy optimization and converge on their optimal gaits</title><author>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Selinger, Jessica C.</creatorcontrib><creatorcontrib>Wong, Jeremy D.</creatorcontrib><creatorcontrib>Simha, Surabhi N.</creatorcontrib><creatorcontrib>Donelan, J. Maxwell</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of experimental biology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Selinger, Jessica C.</au><au>Wong, Jeremy D.</au><au>Simha, Surabhi N.</au><au>Donelan, J. Maxwell</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>How people initiate energy optimization and converge on their optimal gaits</atitle><jtitle>Journal of experimental biology</jtitle><date>2019-01-01</date><risdate>2019</risdate><issn>0022-0949</issn><eissn>1477-9145</eissn><abstract>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</abstract><doi>10.1242/jeb.198234</doi><orcidid>https://orcid.org/0000-0001-9372-6705</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0022-0949
ispartof Journal of experimental biology, 2019-01
issn 0022-0949
1477-9145
language eng
recordid cdi_crossref_primary_10_1242_jeb_198234
source Alma/SFX Local Collection; EZB Electronic Journals Library; Company of Biologists
title How people initiate energy optimization and converge on their optimal gaits
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-11T18%3A28%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=How%20people%20initiate%20energy%20optimization%20and%20converge%20on%20their%20optimal%20gaits&rft.jtitle=Journal%20of%20experimental%20biology&rft.au=Selinger,%20Jessica%20C.&rft.date=2019-01-01&rft.issn=0022-0949&rft.eissn=1477-9145&rft_id=info:doi/10.1242/jeb.198234&rft_dat=%3Ccrossref%3E10_1242_jeb_198234%3C/crossref%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true