How people initiate energy optimization and converge on their optimal gaits
A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordinat...
Gespeichert in:
Veröffentlicht in: | Journal of experimental biology 2019-01 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | Journal of experimental biology |
container_volume | |
creator | Selinger, Jessica C. Wong, Jeremy D. Simha, Surabhi N. Donelan, J. Maxwell |
description | A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step. |
doi_str_mv | 10.1242/jeb.198234 |
format | Article |
fullrecord | <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1242_jeb_198234</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1242_jeb_198234</sourcerecordid><originalsourceid>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</originalsourceid><addsrcrecordid>eNotkE1LxDAQhoMoWFcv_oKcha6Tj6bNURZ1xQUvei7TNFmz1KYkQVl_vV3qXIbhfRkeHkJuGawZl_z-YLs10w0X8owUTNZ1qZmszkkBwHkJWupLcpXSAeZRlSzI6zb80MmGabDUjz57zJba0cb9kYYp-y__i9mHkeLYUxPG7zmxdL7zp_VxqeBA9-hzuiYXDodkb_73inw8Pb5vtuXu7fll87ArDZshS1M7AU6gNZXUHDlrHChTYc91X0HPbA2qgw6kVg2CagwwJVAaQNcbhVysyN3y18SQUrSuneJMEY8tg_akoZ01tIsG8QdhGlDa</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>How people initiate energy optimization and converge on their optimal gaits</title><source>Alma/SFX Local Collection</source><source>EZB Electronic Journals Library</source><source>Company of Biologists</source><creator>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</creator><creatorcontrib>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</creatorcontrib><description>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</description><identifier>ISSN: 0022-0949</identifier><identifier>EISSN: 1477-9145</identifier><identifier>DOI: 10.1242/jeb.198234</identifier><language>eng</language><ispartof>Journal of experimental biology, 2019-01</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</citedby><cites>FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</cites><orcidid>0000-0001-9372-6705</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,3665,27901,27902</link.rule.ids></links><search><creatorcontrib>Selinger, Jessica C.</creatorcontrib><creatorcontrib>Wong, Jeremy D.</creatorcontrib><creatorcontrib>Simha, Surabhi N.</creatorcontrib><creatorcontrib>Donelan, J. Maxwell</creatorcontrib><title>How people initiate energy optimization and converge on their optimal gaits</title><title>Journal of experimental biology</title><description>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</description><issn>0022-0949</issn><issn>1477-9145</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNotkE1LxDAQhoMoWFcv_oKcha6Tj6bNURZ1xQUvei7TNFmz1KYkQVl_vV3qXIbhfRkeHkJuGawZl_z-YLs10w0X8owUTNZ1qZmszkkBwHkJWupLcpXSAeZRlSzI6zb80MmGabDUjz57zJba0cb9kYYp-y__i9mHkeLYUxPG7zmxdL7zp_VxqeBA9-hzuiYXDodkb_73inw8Pb5vtuXu7fll87ArDZshS1M7AU6gNZXUHDlrHChTYc91X0HPbA2qgw6kVg2CagwwJVAaQNcbhVysyN3y18SQUrSuneJMEY8tg_akoZ01tIsG8QdhGlDa</recordid><startdate>20190101</startdate><enddate>20190101</enddate><creator>Selinger, Jessica C.</creator><creator>Wong, Jeremy D.</creator><creator>Simha, Surabhi N.</creator><creator>Donelan, J. Maxwell</creator><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-9372-6705</orcidid></search><sort><creationdate>20190101</creationdate><title>How people initiate energy optimization and converge on their optimal gaits</title><author>Selinger, Jessica C. ; Wong, Jeremy D. ; Simha, Surabhi N. ; Donelan, J. Maxwell</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c1124-c7f30f3aec5492a218f06c5ad29d50d1e706b0b04968a068c0163a4c0afdc6a23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Selinger, Jessica C.</creatorcontrib><creatorcontrib>Wong, Jeremy D.</creatorcontrib><creatorcontrib>Simha, Surabhi N.</creatorcontrib><creatorcontrib>Donelan, J. Maxwell</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of experimental biology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Selinger, Jessica C.</au><au>Wong, Jeremy D.</au><au>Simha, Surabhi N.</au><au>Donelan, J. Maxwell</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>How people initiate energy optimization and converge on their optimal gaits</atitle><jtitle>Journal of experimental biology</jtitle><date>2019-01-01</date><risdate>2019</risdate><issn>0022-0949</issn><eissn>1477-9145</eissn><abstract>A central principle in motor control is that the coordination strategies learned by our nervous system are often optimal. Here we combined human experiments with computational reinforcement learning models to study how the nervous system navigates possible movements to arrive at an optimal coordination. Our experiments used robotic exoskeletons to reshape the relationship between how participants walk and how much energy they consume. We found that while some participants used their relatively high natural gait variability to explore the new energetic landscape and spontaneously initiate energy optimization, most participants preferred to exploit their originally preferred, but now suboptimal, gait. We could nevertheless reliably initiate optimization in these exploiters by providing them with the experience of lower cost gaits suggesting that the nervous system benefits from cues about the relevant dimensions along which to re-optimize its coordination. Once optimization was initiated, we found that the nervous system employed a local search process to converge on the new optimum gait over tens of seconds. Once optimization was completed, the nervous system learned to predict this new optimal gait and rapidly returned to it within a few steps if perturbed away. We then use our data to develop reinforcement learning models that can predict experimental behaviours, and these models to inductively reason about how the nervous system optimizes coordination. We conclude that the nervous system optimizes for energy using a prediction of the optimal gait, and then refines this prediction with the cost of each new walking step.</abstract><doi>10.1242/jeb.198234</doi><orcidid>https://orcid.org/0000-0001-9372-6705</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0022-0949 |
ispartof | Journal of experimental biology, 2019-01 |
issn | 0022-0949 1477-9145 |
language | eng |
recordid | cdi_crossref_primary_10_1242_jeb_198234 |
source | Alma/SFX Local Collection; EZB Electronic Journals Library; Company of Biologists |
title | How people initiate energy optimization and converge on their optimal gaits |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-11T18%3A28%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=How%20people%20initiate%20energy%20optimization%20and%20converge%20on%20their%20optimal%20gaits&rft.jtitle=Journal%20of%20experimental%20biology&rft.au=Selinger,%20Jessica%20C.&rft.date=2019-01-01&rft.issn=0022-0949&rft.eissn=1477-9145&rft_id=info:doi/10.1242/jeb.198234&rft_dat=%3Ccrossref%3E10_1242_jeb_198234%3C/crossref%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |