A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning

A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning system...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Adaptive behavior 1993-01, Vol.1 (3), p.263-319
Hauptverfasser: Klopf, A. Harry, Weaver, Scott E., Morgan, James S.
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 319
container_issue 3
container_start_page 263
container_title Adaptive behavior
container_volume 1
creator Klopf, A. Harry
Weaver, Scott E.
Morgan, James S.
description A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning systems consisting of ACP networks, employing the drive-reinforcement learning mechanism (Klopf, 1988) and engaging in real-time, closed-loop, goal-seeking interactions with environments, are capable of being classically and instrumentally conditioned, as demonstrated by means of computer simulations. In multiple-T mazes, the systems learn to chain responses that avoid punishment and that lead eventually to reward. The temporal order in which the responses are learned and extinguished during instrumental conditioning is consistent with that observed in animal learning. Also consistent with animal learning experimental evidence, the ACP network model accounts for a wide range of classical conditioning phenomena. ACP networks, at their current stage of development, are intended to model sensorimotor, limbic, and hypothalamic nervous system function, suggesting a relationship between classical and instrumental conditioning that extends Mowrer's (1956, 1960a/1973) two-factor theory of learning. In conjunction with consideration of limbic system and hypothalamic function, the role of emotion in natural intelligence is modeled and discussed. ACP networks constitute solutions to temporal and structural credit assignment problems, suggesting a theoretical approach for the synthesis of machine intelligence.
doi_str_mv 10.1177/105971239300100302
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_20675393</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1177_105971239300100302</sage_id><sourcerecordid>20675393</sourcerecordid><originalsourceid>FETCH-LOGICAL-c233t-40112b3f10fadb7ff3d797d583e547e0f0f3b1f2f946c30119745899a71ff5b93</originalsourceid><addsrcrecordid>eNp9kMFOwzAQRCMEEqXwA5x84ha6tpO45lYFSisVOADnyEnsNiWxi-2A-gH8Nw7lhsRpV7tvRpqJoksM1xgzNsGQcoYJ5RQAA1AgR9EIswTHJKP0OOwBiAfiNDpzbgsAWVCMoq8ZWjTSClttmkq06FH6T2PfkFEoN9pb06LnvfOyc8hvhEcrKay-QQ-mlm2j14G3H6Z3vxCa97ryjdHotrfDO2-Fcz_GQtdoqZ23fSe1D4dgXzcDG7jz6ESJ1smL3zmOXud3L_kiXj3dL_PZKq4IpT5OAGNSUoVBibpkStGacVanUyrThElQoGiJFVE8ySoaYM6SdMq5YFiptOR0HF0dfHfWvPfS-aJrXCXbVmgZUhQEMpaGEgNIDmBljXNWqmJnm07YfYGhGBov_jYeRJODyIm1LLamtzqE-U_xDdX-glk</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>20675393</pqid></control><display><type>article</type><title>A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning</title><source>Access via SAGE</source><creator>Klopf, A. Harry ; Weaver, Scott E. ; Morgan, James S.</creator><creatorcontrib>Klopf, A. Harry ; Weaver, Scott E. ; Morgan, James S.</creatorcontrib><description>A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning systems consisting of ACP networks, employing the drive-reinforcement learning mechanism (Klopf, 1988) and engaging in real-time, closed-loop, goal-seeking interactions with environments, are capable of being classically and instrumentally conditioned, as demonstrated by means of computer simulations. In multiple-T mazes, the systems learn to chain responses that avoid punishment and that lead eventually to reward. The temporal order in which the responses are learned and extinguished during instrumental conditioning is consistent with that observed in animal learning. Also consistent with animal learning experimental evidence, the ACP network model accounts for a wide range of classical conditioning phenomena. ACP networks, at their current stage of development, are intended to model sensorimotor, limbic, and hypothalamic nervous system function, suggesting a relationship between classical and instrumental conditioning that extends Mowrer's (1956, 1960a/1973) two-factor theory of learning. In conjunction with consideration of limbic system and hypothalamic function, the role of emotion in natural intelligence is modeled and discussed. ACP networks constitute solutions to temporal and structural credit assignment problems, suggesting a theoretical approach for the synthesis of machine intelligence.</description><identifier>ISSN: 1059-7123</identifier><identifier>EISSN: 1741-2633</identifier><identifier>DOI: 10.1177/105971239300100302</identifier><language>eng</language><publisher>Thousand Oaks, CA: Sage Publications</publisher><ispartof>Adaptive behavior, 1993-01, Vol.1 (3), p.263-319</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c233t-40112b3f10fadb7ff3d797d583e547e0f0f3b1f2f946c30119745899a71ff5b93</citedby><cites>FETCH-LOGICAL-c233t-40112b3f10fadb7ff3d797d583e547e0f0f3b1f2f946c30119745899a71ff5b93</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1177/105971239300100302$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1177/105971239300100302$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,780,784,21819,27924,27925,43621,43622</link.rule.ids></links><search><creatorcontrib>Klopf, A. Harry</creatorcontrib><creatorcontrib>Weaver, Scott E.</creatorcontrib><creatorcontrib>Morgan, James S.</creatorcontrib><title>A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning</title><title>Adaptive behavior</title><description>A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning systems consisting of ACP networks, employing the drive-reinforcement learning mechanism (Klopf, 1988) and engaging in real-time, closed-loop, goal-seeking interactions with environments, are capable of being classically and instrumentally conditioned, as demonstrated by means of computer simulations. In multiple-T mazes, the systems learn to chain responses that avoid punishment and that lead eventually to reward. The temporal order in which the responses are learned and extinguished during instrumental conditioning is consistent with that observed in animal learning. Also consistent with animal learning experimental evidence, the ACP network model accounts for a wide range of classical conditioning phenomena. ACP networks, at their current stage of development, are intended to model sensorimotor, limbic, and hypothalamic nervous system function, suggesting a relationship between classical and instrumental conditioning that extends Mowrer's (1956, 1960a/1973) two-factor theory of learning. In conjunction with consideration of limbic system and hypothalamic function, the role of emotion in natural intelligence is modeled and discussed. ACP networks constitute solutions to temporal and structural credit assignment problems, suggesting a theoretical approach for the synthesis of machine intelligence.</description><issn>1059-7123</issn><issn>1741-2633</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>1993</creationdate><recordtype>article</recordtype><recordid>eNp9kMFOwzAQRCMEEqXwA5x84ha6tpO45lYFSisVOADnyEnsNiWxi-2A-gH8Nw7lhsRpV7tvRpqJoksM1xgzNsGQcoYJ5RQAA1AgR9EIswTHJKP0OOwBiAfiNDpzbgsAWVCMoq8ZWjTSClttmkq06FH6T2PfkFEoN9pb06LnvfOyc8hvhEcrKay-QQ-mlm2j14G3H6Z3vxCa97ryjdHotrfDO2-Fcz_GQtdoqZ23fSe1D4dgXzcDG7jz6ESJ1smL3zmOXud3L_kiXj3dL_PZKq4IpT5OAGNSUoVBibpkStGacVanUyrThElQoGiJFVE8ySoaYM6SdMq5YFiptOR0HF0dfHfWvPfS-aJrXCXbVmgZUhQEMpaGEgNIDmBljXNWqmJnm07YfYGhGBov_jYeRJODyIm1LLamtzqE-U_xDdX-glk</recordid><startdate>199301</startdate><enddate>199301</enddate><creator>Klopf, A. Harry</creator><creator>Weaver, Scott E.</creator><creator>Morgan, James S.</creator><general>Sage Publications</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7QG</scope><scope>7TK</scope></search><sort><creationdate>199301</creationdate><title>A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning</title><author>Klopf, A. Harry ; Weaver, Scott E. ; Morgan, James S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c233t-40112b3f10fadb7ff3d797d583e547e0f0f3b1f2f946c30119745899a71ff5b93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>1993</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Klopf, A. Harry</creatorcontrib><creatorcontrib>Weaver, Scott E.</creatorcontrib><creatorcontrib>Morgan, James S.</creatorcontrib><collection>CrossRef</collection><collection>Animal Behavior Abstracts</collection><collection>Neurosciences Abstracts</collection><jtitle>Adaptive behavior</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Klopf, A. Harry</au><au>Weaver, Scott E.</au><au>Morgan, James S.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning</atitle><jtitle>Adaptive behavior</jtitle><date>1993-01</date><risdate>1993</risdate><volume>1</volume><issue>3</issue><spage>263</spage><epage>319</epage><pages>263-319</pages><issn>1059-7123</issn><eissn>1741-2633</eissn><abstract>A computational model of nervous system function during classical and instrumental conditioning is proposed. The model assumes the form of a hierarchical network of control systems. Each control system is capable of learning and is referred to as an associative control process (ACP). Learning systems consisting of ACP networks, employing the drive-reinforcement learning mechanism (Klopf, 1988) and engaging in real-time, closed-loop, goal-seeking interactions with environments, are capable of being classically and instrumentally conditioned, as demonstrated by means of computer simulations. In multiple-T mazes, the systems learn to chain responses that avoid punishment and that lead eventually to reward. The temporal order in which the responses are learned and extinguished during instrumental conditioning is consistent with that observed in animal learning. Also consistent with animal learning experimental evidence, the ACP network model accounts for a wide range of classical conditioning phenomena. ACP networks, at their current stage of development, are intended to model sensorimotor, limbic, and hypothalamic nervous system function, suggesting a relationship between classical and instrumental conditioning that extends Mowrer's (1956, 1960a/1973) two-factor theory of learning. In conjunction with consideration of limbic system and hypothalamic function, the role of emotion in natural intelligence is modeled and discussed. ACP networks constitute solutions to temporal and structural credit assignment problems, suggesting a theoretical approach for the synthesis of machine intelligence.</abstract><cop>Thousand Oaks, CA</cop><pub>Sage Publications</pub><doi>10.1177/105971239300100302</doi><tpages>57</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1059-7123
ispartof Adaptive behavior, 1993-01, Vol.1 (3), p.263-319
issn 1059-7123
1741-2633
language eng
recordid cdi_proquest_miscellaneous_20675393
source Access via SAGE
title A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T11%3A24%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Hierarchical%20Network%20of%20Control%20Systems%20that%20Learn:%20Modeling%20Nervous%20System%20Function%20During%20Classical%20and%20Instrumental%20Conditioning&rft.jtitle=Adaptive%20behavior&rft.au=Klopf,%20A.%20Harry&rft.date=1993-01&rft.volume=1&rft.issue=3&rft.spage=263&rft.epage=319&rft.pages=263-319&rft.issn=1059-7123&rft.eissn=1741-2633&rft_id=info:doi/10.1177/105971239300100302&rft_dat=%3Cproquest_cross%3E20675393%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=20675393&rft_id=info:pmid/&rft_sage_id=10.1177_105971239300100302&rfr_iscdi=true