Dendritic solutions to the credit assignment problem

•Learning in hierarchical neural networks requires credit assignment.•Credit assignment is difficult if regular inputs mix with credit signals.•Dendritic mechanisms provide potential means of distinguishing credit signals.•Evidence supports credit assignment in apical dendrites of pyramidal neurons....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Current opinion in neurobiology 2019-02, Vol.54, p.28-36
Hauptverfasser: Richards, Blake A, Lillicrap, Timothy P
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 36
container_issue
container_start_page 28
container_title Current opinion in neurobiology
container_volume 54
creator Richards, Blake A
Lillicrap, Timothy P
description •Learning in hierarchical neural networks requires credit assignment.•Credit assignment is difficult if regular inputs mix with credit signals.•Dendritic mechanisms provide potential means of distinguishing credit signals.•Evidence supports credit assignment in apical dendrites of pyramidal neurons. Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The ‘credit assignment problem’ refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.
doi_str_mv 10.1016/j.conb.2018.08.003
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2102922731</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0959438818300485</els_id><sourcerecordid>2102922731</sourcerecordid><originalsourceid>FETCH-LOGICAL-c422t-2c12cd503174bf3d20f7dfb4c3487cdf4f8b1766547b3c10bf830fe5da3c15473</originalsourceid><addsrcrecordid>eNp9kE1LxDAQhoMo7rr6BzxIj15aJx9ts-BF_IYFL3oOzZdmaZs1SQX_vVl29SgMDDO87zvMg9A5hgoDbq7WlfKjrAhgXkEuoAdojnlLy4ZzcojmsKyXJaOcz9BJjGsAaCinx2hGgUBNmmaO2J0ZdXDJqSL6fkrOj7FIvkgfplDBaJeKLkb3Pg5mTMUmeNmb4RQd2a6P5mzfF-jt4f719qlcvTw-396sSsUISSVRmChdA8Utk5ZqArbVVjJFGW-VtsxyidumqVkrqcIgLadgTa27POUlXaDLXW6--zmZmMTgojJ9343GT1EQDGRJSEtxlpKdVAUfYzBWbIIbuvAtMIgtLbEWW1piS0tALqDZdLHPn-Rg9J_lF08WXO8EJn_55UwQUTkzqswlGJWE9u6__B-_uHqu</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2102922731</pqid></control><display><type>article</type><title>Dendritic solutions to the credit assignment problem</title><source>Access via ScienceDirect (Elsevier)</source><creator>Richards, Blake A ; Lillicrap, Timothy P</creator><creatorcontrib>Richards, Blake A ; Lillicrap, Timothy P</creatorcontrib><description>•Learning in hierarchical neural networks requires credit assignment.•Credit assignment is difficult if regular inputs mix with credit signals.•Dendritic mechanisms provide potential means of distinguishing credit signals.•Evidence supports credit assignment in apical dendrites of pyramidal neurons. Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The ‘credit assignment problem’ refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.</description><identifier>ISSN: 0959-4388</identifier><identifier>EISSN: 1873-6882</identifier><identifier>DOI: 10.1016/j.conb.2018.08.003</identifier><identifier>PMID: 30205266</identifier><language>eng</language><publisher>England: Elsevier Ltd</publisher><ispartof>Current opinion in neurobiology, 2019-02, Vol.54, p.28-36</ispartof><rights>2018 Elsevier Ltd</rights><rights>Copyright © 2018 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c422t-2c12cd503174bf3d20f7dfb4c3487cdf4f8b1766547b3c10bf830fe5da3c15473</citedby><cites>FETCH-LOGICAL-c422t-2c12cd503174bf3d20f7dfb4c3487cdf4f8b1766547b3c10bf830fe5da3c15473</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.conb.2018.08.003$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30205266$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Richards, Blake A</creatorcontrib><creatorcontrib>Lillicrap, Timothy P</creatorcontrib><title>Dendritic solutions to the credit assignment problem</title><title>Current opinion in neurobiology</title><addtitle>Curr Opin Neurobiol</addtitle><description>•Learning in hierarchical neural networks requires credit assignment.•Credit assignment is difficult if regular inputs mix with credit signals.•Dendritic mechanisms provide potential means of distinguishing credit signals.•Evidence supports credit assignment in apical dendrites of pyramidal neurons. Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The ‘credit assignment problem’ refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.</description><issn>0959-4388</issn><issn>1873-6882</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LxDAQhoMo7rr6BzxIj15aJx9ts-BF_IYFL3oOzZdmaZs1SQX_vVl29SgMDDO87zvMg9A5hgoDbq7WlfKjrAhgXkEuoAdojnlLy4ZzcojmsKyXJaOcz9BJjGsAaCinx2hGgUBNmmaO2J0ZdXDJqSL6fkrOj7FIvkgfplDBaJeKLkb3Pg5mTMUmeNmb4RQd2a6P5mzfF-jt4f719qlcvTw-396sSsUISSVRmChdA8Utk5ZqArbVVjJFGW-VtsxyidumqVkrqcIgLadgTa27POUlXaDLXW6--zmZmMTgojJ9343GT1EQDGRJSEtxlpKdVAUfYzBWbIIbuvAtMIgtLbEWW1piS0tALqDZdLHPn-Rg9J_lF08WXO8EJn_55UwQUTkzqswlGJWE9u6__B-_uHqu</recordid><startdate>201902</startdate><enddate>201902</enddate><creator>Richards, Blake A</creator><creator>Lillicrap, Timothy P</creator><general>Elsevier Ltd</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>201902</creationdate><title>Dendritic solutions to the credit assignment problem</title><author>Richards, Blake A ; Lillicrap, Timothy P</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c422t-2c12cd503174bf3d20f7dfb4c3487cdf4f8b1766547b3c10bf830fe5da3c15473</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Richards, Blake A</creatorcontrib><creatorcontrib>Lillicrap, Timothy P</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Current opinion in neurobiology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Richards, Blake A</au><au>Lillicrap, Timothy P</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dendritic solutions to the credit assignment problem</atitle><jtitle>Current opinion in neurobiology</jtitle><addtitle>Curr Opin Neurobiol</addtitle><date>2019-02</date><risdate>2019</risdate><volume>54</volume><spage>28</spage><epage>36</epage><pages>28-36</pages><issn>0959-4388</issn><eissn>1873-6882</eissn><abstract>•Learning in hierarchical neural networks requires credit assignment.•Credit assignment is difficult if regular inputs mix with credit signals.•Dendritic mechanisms provide potential means of distinguishing credit signals.•Evidence supports credit assignment in apical dendrites of pyramidal neurons. Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The ‘credit assignment problem’ refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.</abstract><cop>England</cop><pub>Elsevier Ltd</pub><pmid>30205266</pmid><doi>10.1016/j.conb.2018.08.003</doi><tpages>9</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0959-4388
ispartof Current opinion in neurobiology, 2019-02, Vol.54, p.28-36
issn 0959-4388
1873-6882
language eng
recordid cdi_proquest_miscellaneous_2102922731
source Access via ScienceDirect (Elsevier)
title Dendritic solutions to the credit assignment problem
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T21%3A26%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dendritic%20solutions%20to%20the%20credit%20assignment%20problem&rft.jtitle=Current%20opinion%20in%20neurobiology&rft.au=Richards,%20Blake%20A&rft.date=2019-02&rft.volume=54&rft.spage=28&rft.epage=36&rft.pages=28-36&rft.issn=0959-4388&rft.eissn=1873-6882&rft_id=info:doi/10.1016/j.conb.2018.08.003&rft_dat=%3Cproquest_cross%3E2102922731%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2102922731&rft_id=info:pmid/30205266&rft_els_id=S0959438818300485&rfr_iscdi=true