A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time
Autonomous learning is the ability to form knowledge representations solely through one's own experience. To autonomously learn, an agent must be able to perceive, act, memorize, plan, and desire; it must be able to form intentional states. We build on a neural process account of intentionality...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on cognitive and developmental systems 2022-03, Vol.14 (1), p.90-101 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 101 |
---|---|
container_issue | 1 |
container_start_page | 90 |
container_title | IEEE transactions on cognitive and developmental systems |
container_volume | 14 |
creator | Tekulve, Jan Schoner, Gregor |
description | Autonomous learning is the ability to form knowledge representations solely through one's own experience. To autonomously learn, an agent must be able to perceive, act, memorize, plan, and desire; it must be able to form intentional states. We build on a neural process account of intentionality, in which intentional states are stabilized by interactions within populations of neurons that represent perceptual features and movement parameters. Instabilities in such neural dynamics induce sequences of intentional behavior. In this article, we examine the neural process organization required to decide and control when learning takes place, to build the representations that can hold learning data, and to organize the selection of neural substrate to learn the novel patterns. We demonstrate how a neural dynamic network may learn new beliefs about the world from single experiences, may activate and use beliefs to satisfy desires, and may deactivate beliefs when their predictions do not match experience. We illustrate the ideas in a simple toy scenario in which a simulated agent autonomously explores an environment, directs action at objects, and forms beliefs about simple contingencies in this environment. The agent utilizes learned beliefs to satisfy its own fixed desires. |
doi_str_mv | 10.1109/TCDS.2020.3013768 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9154474</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9154474</ieee_id><sourcerecordid>2638124555</sourcerecordid><originalsourceid>FETCH-LOGICAL-c293t-f4656f8ed92001a23370d5f2d94e99c0c457463592c45bae7e025113157aa5d63</originalsourceid><addsrcrecordid>eNo9kEtPwzAQhCMEEhX0ByAuljin-BnHx5LyqFTBgXCOTLKhLold7ATUf4-rVj3trPab1WiS5IbgGSFY3ZfF4n1GMcUzhgmTWX6WTCiTKs0VU-cnTfFlMg1hgzEmGZM5l5NkPUevMHrdocXO6t7UcR3-nP9GC29-ISBt0dIOYAfjbKTmX1Gicq0HNB8HZ13vxtDt0Aq0twE9QGegDchYVLjosWM8o9L0cJ1ctLoLMD3Oq-Tj6bEsXtLV2_OymK_Smio2pC3PRNbm0MS0mGjKmMSNaGmjOChV45oLyTMmFI3qU4METAUhjAiptWgydpXcHf5uvfsZIQzVxo0-Rg8VzVhOKBdCRIocqNq7EDy01dabXvtdRXC177Tad1rtO62OnUbP7cFjAODEKyI4l5z9AzXBcZg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2638124555</pqid></control><display><type>article</type><title>A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time</title><source>IEEE Electronic Library (IEL)</source><creator>Tekulve, Jan ; Schoner, Gregor</creator><creatorcontrib>Tekulve, Jan ; Schoner, Gregor</creatorcontrib><description>Autonomous learning is the ability to form knowledge representations solely through one's own experience. To autonomously learn, an agent must be able to perceive, act, memorize, plan, and desire; it must be able to form intentional states. We build on a neural process account of intentionality, in which intentional states are stabilized by interactions within populations of neurons that represent perceptual features and movement parameters. Instabilities in such neural dynamics induce sequences of intentional behavior. In this article, we examine the neural process organization required to decide and control when learning takes place, to build the representations that can hold learning data, and to organize the selection of neural substrate to learn the novel patterns. We demonstrate how a neural dynamic network may learn new beliefs about the world from single experiences, may activate and use beliefs to satisfy desires, and may deactivate beliefs when their predictions do not match experience. We illustrate the ideas in a simple toy scenario in which a simulated agent autonomously explores an environment, directs action at objects, and forms beliefs about simple contingencies in this environment. The agent utilizes learned beliefs to satisfy its own fixed desires.</description><identifier>ISSN: 2379-8920</identifier><identifier>EISSN: 2379-8939</identifier><identifier>DOI: 10.1109/TCDS.2020.3013768</identifier><identifier>CODEN: ITCDA4</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Autonomous agent ; Color ; Discrete Fourier transforms ; fast learning ; Knowledge representation ; Learning ; learning beliefs ; neural cognitive architecture ; neural dynamics ; Neural networks ; Paints ; Robot sensing systems ; Substrates ; Transient analysis</subject><ispartof>IEEE transactions on cognitive and developmental systems, 2022-03, Vol.14 (1), p.90-101</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c293t-f4656f8ed92001a23370d5f2d94e99c0c457463592c45bae7e025113157aa5d63</citedby><cites>FETCH-LOGICAL-c293t-f4656f8ed92001a23370d5f2d94e99c0c457463592c45bae7e025113157aa5d63</cites><orcidid>0000-0002-4776-9998 ; 0000-0003-0541-765X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9154474$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9154474$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Tekulve, Jan</creatorcontrib><creatorcontrib>Schoner, Gregor</creatorcontrib><title>A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time</title><title>IEEE transactions on cognitive and developmental systems</title><addtitle>TCDS</addtitle><description>Autonomous learning is the ability to form knowledge representations solely through one's own experience. To autonomously learn, an agent must be able to perceive, act, memorize, plan, and desire; it must be able to form intentional states. We build on a neural process account of intentionality, in which intentional states are stabilized by interactions within populations of neurons that represent perceptual features and movement parameters. Instabilities in such neural dynamics induce sequences of intentional behavior. In this article, we examine the neural process organization required to decide and control when learning takes place, to build the representations that can hold learning data, and to organize the selection of neural substrate to learn the novel patterns. We demonstrate how a neural dynamic network may learn new beliefs about the world from single experiences, may activate and use beliefs to satisfy desires, and may deactivate beliefs when their predictions do not match experience. We illustrate the ideas in a simple toy scenario in which a simulated agent autonomously explores an environment, directs action at objects, and forms beliefs about simple contingencies in this environment. The agent utilizes learned beliefs to satisfy its own fixed desires.</description><subject>Autonomous agent</subject><subject>Color</subject><subject>Discrete Fourier transforms</subject><subject>fast learning</subject><subject>Knowledge representation</subject><subject>Learning</subject><subject>learning beliefs</subject><subject>neural cognitive architecture</subject><subject>neural dynamics</subject><subject>Neural networks</subject><subject>Paints</subject><subject>Robot sensing systems</subject><subject>Substrates</subject><subject>Transient analysis</subject><issn>2379-8920</issn><issn>2379-8939</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEtPwzAQhCMEEhX0ByAuljin-BnHx5LyqFTBgXCOTLKhLold7ATUf4-rVj3trPab1WiS5IbgGSFY3ZfF4n1GMcUzhgmTWX6WTCiTKs0VU-cnTfFlMg1hgzEmGZM5l5NkPUevMHrdocXO6t7UcR3-nP9GC29-ISBt0dIOYAfjbKTmX1Gicq0HNB8HZ13vxtDt0Aq0twE9QGegDchYVLjosWM8o9L0cJ1ctLoLMD3Oq-Tj6bEsXtLV2_OymK_Smio2pC3PRNbm0MS0mGjKmMSNaGmjOChV45oLyTMmFI3qU4METAUhjAiptWgydpXcHf5uvfsZIQzVxo0-Rg8VzVhOKBdCRIocqNq7EDy01dabXvtdRXC177Tad1rtO62OnUbP7cFjAODEKyI4l5z9AzXBcZg</recordid><startdate>20220301</startdate><enddate>20220301</enddate><creator>Tekulve, Jan</creator><creator>Schoner, Gregor</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-4776-9998</orcidid><orcidid>https://orcid.org/0000-0003-0541-765X</orcidid></search><sort><creationdate>20220301</creationdate><title>A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time</title><author>Tekulve, Jan ; Schoner, Gregor</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c293t-f4656f8ed92001a23370d5f2d94e99c0c457463592c45bae7e025113157aa5d63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Autonomous agent</topic><topic>Color</topic><topic>Discrete Fourier transforms</topic><topic>fast learning</topic><topic>Knowledge representation</topic><topic>Learning</topic><topic>learning beliefs</topic><topic>neural cognitive architecture</topic><topic>neural dynamics</topic><topic>Neural networks</topic><topic>Paints</topic><topic>Robot sensing systems</topic><topic>Substrates</topic><topic>Transient analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>Tekulve, Jan</creatorcontrib><creatorcontrib>Schoner, Gregor</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on cognitive and developmental systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Tekulve, Jan</au><au>Schoner, Gregor</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time</atitle><jtitle>IEEE transactions on cognitive and developmental systems</jtitle><stitle>TCDS</stitle><date>2022-03-01</date><risdate>2022</risdate><volume>14</volume><issue>1</issue><spage>90</spage><epage>101</epage><pages>90-101</pages><issn>2379-8920</issn><eissn>2379-8939</eissn><coden>ITCDA4</coden><abstract>Autonomous learning is the ability to form knowledge representations solely through one's own experience. To autonomously learn, an agent must be able to perceive, act, memorize, plan, and desire; it must be able to form intentional states. We build on a neural process account of intentionality, in which intentional states are stabilized by interactions within populations of neurons that represent perceptual features and movement parameters. Instabilities in such neural dynamics induce sequences of intentional behavior. In this article, we examine the neural process organization required to decide and control when learning takes place, to build the representations that can hold learning data, and to organize the selection of neural substrate to learn the novel patterns. We demonstrate how a neural dynamic network may learn new beliefs about the world from single experiences, may activate and use beliefs to satisfy desires, and may deactivate beliefs when their predictions do not match experience. We illustrate the ideas in a simple toy scenario in which a simulated agent autonomously explores an environment, directs action at objects, and forms beliefs about simple contingencies in this environment. The agent utilizes learned beliefs to satisfy its own fixed desires.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TCDS.2020.3013768</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-4776-9998</orcidid><orcidid>https://orcid.org/0000-0003-0541-765X</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2379-8920 |
ispartof | IEEE transactions on cognitive and developmental systems, 2022-03, Vol.14 (1), p.90-101 |
issn | 2379-8920 2379-8939 |
language | eng |
recordid | cdi_ieee_primary_9154474 |
source | IEEE Electronic Library (IEL) |
subjects | Autonomous agent Color Discrete Fourier transforms fast learning Knowledge representation Learning learning beliefs neural cognitive architecture neural dynamics Neural networks Paints Robot sensing systems Substrates Transient analysis |
title | A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T02%3A37%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Neural%20Dynamic%20Network%20Drives%20an%20Intentional%20Agent%20That%20Autonomously%20Learns%20Beliefs%20in%20Continuous%20Time&rft.jtitle=IEEE%20transactions%20on%20cognitive%20and%20developmental%20systems&rft.au=Tekulve,%20Jan&rft.date=2022-03-01&rft.volume=14&rft.issue=1&rft.spage=90&rft.epage=101&rft.pages=90-101&rft.issn=2379-8920&rft.eissn=2379-8939&rft.coden=ITCDA4&rft_id=info:doi/10.1109/TCDS.2020.3013768&rft_dat=%3Cproquest_RIE%3E2638124555%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2638124555&rft_id=info:pmid/&rft_ieee_id=9154474&rfr_iscdi=true |