Transitions in echo index and dependence on input repetitions
The echo index counts the number of simultaneously stable asymptotic responses of a nonautonomous (i.e. input-driven) dynamical system. It generalizes the well-known echo state property for recurrent neural networks - this corresponds to the echo index being equal to one. In this paper, we investiga...
Gespeichert in:
Hauptverfasser: | , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Ashwin, Peter Ceni, Andrea |
description | The echo index counts the number of simultaneously stable asymptotic
responses of a nonautonomous (i.e. input-driven) dynamical system. It
generalizes the well-known echo state property for recurrent neural networks -
this corresponds to the echo index being equal to one. In this paper, we
investigate how the echo index depends on parameters that govern typical
responses to a finite-state ergodic external input that forces the dynamics. We
consider the echo index for a nonautonomous system that switches between a
finite set of maps, where we assume that each map possesses a finite set of
hyperbolic equilibrium attractors. We find the minimum and maximum repetitions
of each map are crucial for the resulting echo index. Casting our theoretical
findings in the RNN computing framework, we obtain that for small amplitude
forcing the echo index corresponds to the number of attractors for the
input-free system, while for large amplitude forcing, the echo index reduces to
one. The intermediate regime is the most interesting; in this region the echo
index depends not just on the amplitude of forcing but also on more subtle
properties of the input. |
doi_str_mv | 10.48550/arxiv.2309.04728 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2309_04728</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2309_04728</sourcerecordid><originalsourceid>FETCH-LOGICAL-a678-beb16d3891728a273588f18645fb0ec9f77432c7657a7aa9c6ef77bd7ccc3d543</originalsourceid><addsrcrecordid>eNotj81OwzAQhH3hUBUeoCf8Akmd-GedAwdU0RapEpfco429EZbAiZxQlbevaTmN5pNmdoexTSVKZbUWW0yXcC5rKZpSKKjtir20CeMcljDGmYfIyX2OWT1dOEbPPU2UTXTEx5j59LPwlNlyTzyyhwG_Znr61zVr92_t7licPg7vu9dTgQZs0VNfGS9tU-WTWIPU1g6VNUoPvSDXDABK1g6MBgTExhnKqPfgnJNeK7lmz_fa2__dlMI3pt_ub0d32yGvS3NDIA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Transitions in echo index and dependence on input repetitions</title><source>arXiv.org</source><creator>Ashwin, Peter ; Ceni, Andrea</creator><creatorcontrib>Ashwin, Peter ; Ceni, Andrea</creatorcontrib><description>The echo index counts the number of simultaneously stable asymptotic
responses of a nonautonomous (i.e. input-driven) dynamical system. It
generalizes the well-known echo state property for recurrent neural networks -
this corresponds to the echo index being equal to one. In this paper, we
investigate how the echo index depends on parameters that govern typical
responses to a finite-state ergodic external input that forces the dynamics. We
consider the echo index for a nonautonomous system that switches between a
finite set of maps, where we assume that each map possesses a finite set of
hyperbolic equilibrium attractors. We find the minimum and maximum repetitions
of each map are crucial for the resulting echo index. Casting our theoretical
findings in the RNN computing framework, we obtain that for small amplitude
forcing the echo index corresponds to the number of attractors for the
input-free system, while for large amplitude forcing, the echo index reduces to
one. The intermediate regime is the most interesting; in this region the echo
index depends not just on the amplitude of forcing but also on more subtle
properties of the input.</description><identifier>DOI: 10.48550/arxiv.2309.04728</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Learning ; Mathematics - Dynamical Systems</subject><creationdate>2023-09</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,782,887</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2309.04728$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2309.04728$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Ashwin, Peter</creatorcontrib><creatorcontrib>Ceni, Andrea</creatorcontrib><title>Transitions in echo index and dependence on input repetitions</title><description>The echo index counts the number of simultaneously stable asymptotic
responses of a nonautonomous (i.e. input-driven) dynamical system. It
generalizes the well-known echo state property for recurrent neural networks -
this corresponds to the echo index being equal to one. In this paper, we
investigate how the echo index depends on parameters that govern typical
responses to a finite-state ergodic external input that forces the dynamics. We
consider the echo index for a nonautonomous system that switches between a
finite set of maps, where we assume that each map possesses a finite set of
hyperbolic equilibrium attractors. We find the minimum and maximum repetitions
of each map are crucial for the resulting echo index. Casting our theoretical
findings in the RNN computing framework, we obtain that for small amplitude
forcing the echo index corresponds to the number of attractors for the
input-free system, while for large amplitude forcing, the echo index reduces to
one. The intermediate regime is the most interesting; in this region the echo
index depends not just on the amplitude of forcing but also on more subtle
properties of the input.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Learning</subject><subject>Mathematics - Dynamical Systems</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81OwzAQhH3hUBUeoCf8Akmd-GedAwdU0RapEpfco429EZbAiZxQlbevaTmN5pNmdoexTSVKZbUWW0yXcC5rKZpSKKjtir20CeMcljDGmYfIyX2OWT1dOEbPPU2UTXTEx5j59LPwlNlyTzyyhwG_Znr61zVr92_t7licPg7vu9dTgQZs0VNfGS9tU-WTWIPU1g6VNUoPvSDXDABK1g6MBgTExhnKqPfgnJNeK7lmz_fa2__dlMI3pt_ub0d32yGvS3NDIA</recordid><startdate>20230909</startdate><enddate>20230909</enddate><creator>Ashwin, Peter</creator><creator>Ceni, Andrea</creator><scope>AKY</scope><scope>AKZ</scope><scope>GOX</scope></search><sort><creationdate>20230909</creationdate><title>Transitions in echo index and dependence on input repetitions</title><author>Ashwin, Peter ; Ceni, Andrea</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a678-beb16d3891728a273588f18645fb0ec9f77432c7657a7aa9c6ef77bd7ccc3d543</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Learning</topic><topic>Mathematics - Dynamical Systems</topic><toplevel>online_resources</toplevel><creatorcontrib>Ashwin, Peter</creatorcontrib><creatorcontrib>Ceni, Andrea</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv Mathematics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ashwin, Peter</au><au>Ceni, Andrea</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Transitions in echo index and dependence on input repetitions</atitle><date>2023-09-09</date><risdate>2023</risdate><abstract>The echo index counts the number of simultaneously stable asymptotic
responses of a nonautonomous (i.e. input-driven) dynamical system. It
generalizes the well-known echo state property for recurrent neural networks -
this corresponds to the echo index being equal to one. In this paper, we
investigate how the echo index depends on parameters that govern typical
responses to a finite-state ergodic external input that forces the dynamics. We
consider the echo index for a nonautonomous system that switches between a
finite set of maps, where we assume that each map possesses a finite set of
hyperbolic equilibrium attractors. We find the minimum and maximum repetitions
of each map are crucial for the resulting echo index. Casting our theoretical
findings in the RNN computing framework, we obtain that for small amplitude
forcing the echo index corresponds to the number of attractors for the
input-free system, while for large amplitude forcing, the echo index reduces to
one. The intermediate regime is the most interesting; in this region the echo
index depends not just on the amplitude of forcing but also on more subtle
properties of the input.</abstract><doi>10.48550/arxiv.2309.04728</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2309.04728 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2309_04728 |
source | arXiv.org |
subjects | Computer Science - Artificial Intelligence Computer Science - Learning Mathematics - Dynamical Systems |
title | Transitions in echo index and dependence on input repetitions |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-05T02%3A34%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Transitions%20in%20echo%20index%20and%20dependence%20on%20input%20repetitions&rft.au=Ashwin,%20Peter&rft.date=2023-09-09&rft_id=info:doi/10.48550/arxiv.2309.04728&rft_dat=%3Carxiv_GOX%3E2309_04728%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |