Reward expectation and prediction error in human medial frontal cortex: An EEG study
The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates,...
Gespeichert in:
Veröffentlicht in: | NeuroImage (Orlando, Fla.) Fla.), 2014-01, Vol.84, p.376-382 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 382 |
---|---|
container_issue | |
container_start_page | 376 |
container_title | NeuroImage (Orlando, Fla.) |
container_volume | 84 |
creator | Silvetti, Massimo Nuñez Castellar, Elena Roger, Clémence Verguts, Tom |
description | The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors.
•We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing. |
doi_str_mv | 10.1016/j.neuroimage.2013.08.058 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1500780550</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1053811913009221</els_id><sourcerecordid>1500780550</sourcerecordid><originalsourceid>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</originalsourceid><addsrcrecordid>eNqFkV1rFDEUhoMotl39CxIQwZsZ8znJeFfLtgoFQep1yCRnNMtssiYztf33ZrurBW96lYQ85yTveRDClLSU0O7Dpo2w5BS29ge0jFDeEt0SqZ-hU0p62fRSsef7veSNprQ_QWelbAghPRX6JTphghClSXeKbr7Bb5s9hrsduNnOIUVso8e7DD64hyPknDIOEf9ctjbibb2wEx5zinNdXcoz3H3E5xGv11e4zIu_f4VejHYq8Pq4rtD3y_XNxefm-uvVl4vz68aJTs6Ncz1wrjRjVsmBSTvKsaZjYlADEKq8tlLpvmPODdwK6hhztPO-JqIjOM9X6P2h7y6nXwuU2WxDcTBNNkJaiqHyIaaU5GlUdEL0nHNd0bf_oZu05FiD1IZCcSp4JVdIHyiXUykZRrPL1Ue-N5SYvSSzMY-SzF6SIdpUSbX0zfGBZajT_Ff410oF3h0BW5ydxmyjC-WR06xXsqeV-3TgoA75NkA2xQWIrhrK1abxKTz9mz9eMLOV</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1547314349</pqid></control><display><type>article</type><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals Complete</source><source>ProQuest Central UK/Ireland</source><creator>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</creator><creatorcontrib>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</creatorcontrib><description>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors.
•We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</description><identifier>ISSN: 1053-8119</identifier><identifier>EISSN: 1095-9572</identifier><identifier>DOI: 10.1016/j.neuroimage.2013.08.058</identifier><identifier>PMID: 24007806</identifier><language>eng</language><publisher>Amsterdam: Elsevier Inc</publisher><subject>ACC ; Accuracy ; Adult ; Anticipation, Psychological - physiology ; Biological and medical sciences ; Brain Mapping - methods ; Choice Behavior - physiology ; Cortex (frontal) ; Decision making ; Economic models ; Electroencephalography - methods ; Error correction & detection ; Feedback ; Female ; Frontal Lobe - physiology ; Fundamental and applied biological sciences. Psychology ; Humans ; Male ; Medial frontal cortex ; Monetary incentives ; Neurosciences ; Prediction error ; Primates ; Reinforcement (Psychology) ; Reinforcement learning ; Reward ; Studies ; Vertebrates: nervous system and sense organs ; Young Adult</subject><ispartof>NeuroImage (Orlando, Fla.), 2014-01, Vol.84, p.376-382</ispartof><rights>2013 Elsevier Inc.</rights><rights>2015 INIST-CNRS</rights><rights>2013.</rights><rights>Copyright Elsevier Limited Jan 1, 2014</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</citedby><cites>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/1547314349?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,3550,4024,27923,27924,27925,45995,64385,64387,64389,72469</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=28297591$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24007806$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Silvetti, Massimo</creatorcontrib><creatorcontrib>Nuñez Castellar, Elena</creatorcontrib><creatorcontrib>Roger, Clémence</creatorcontrib><creatorcontrib>Verguts, Tom</creatorcontrib><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><title>NeuroImage (Orlando, Fla.)</title><addtitle>Neuroimage</addtitle><description>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors.
•We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</description><subject>ACC</subject><subject>Accuracy</subject><subject>Adult</subject><subject>Anticipation, Psychological - physiology</subject><subject>Biological and medical sciences</subject><subject>Brain Mapping - methods</subject><subject>Choice Behavior - physiology</subject><subject>Cortex (frontal)</subject><subject>Decision making</subject><subject>Economic models</subject><subject>Electroencephalography - methods</subject><subject>Error correction & detection</subject><subject>Feedback</subject><subject>Female</subject><subject>Frontal Lobe - physiology</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Humans</subject><subject>Male</subject><subject>Medial frontal cortex</subject><subject>Monetary incentives</subject><subject>Neurosciences</subject><subject>Prediction error</subject><subject>Primates</subject><subject>Reinforcement (Psychology)</subject><subject>Reinforcement learning</subject><subject>Reward</subject><subject>Studies</subject><subject>Vertebrates: nervous system and sense organs</subject><subject>Young Adult</subject><issn>1053-8119</issn><issn>1095-9572</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNqFkV1rFDEUhoMotl39CxIQwZsZ8znJeFfLtgoFQep1yCRnNMtssiYztf33ZrurBW96lYQ85yTveRDClLSU0O7Dpo2w5BS29ge0jFDeEt0SqZ-hU0p62fRSsef7veSNprQ_QWelbAghPRX6JTphghClSXeKbr7Bb5s9hrsduNnOIUVso8e7DD64hyPknDIOEf9ctjbibb2wEx5zinNdXcoz3H3E5xGv11e4zIu_f4VejHYq8Pq4rtD3y_XNxefm-uvVl4vz68aJTs6Ncz1wrjRjVsmBSTvKsaZjYlADEKq8tlLpvmPODdwK6hhztPO-JqIjOM9X6P2h7y6nXwuU2WxDcTBNNkJaiqHyIaaU5GlUdEL0nHNd0bf_oZu05FiD1IZCcSp4JVdIHyiXUykZRrPL1Ue-N5SYvSSzMY-SzF6SIdpUSbX0zfGBZajT_Ff410oF3h0BW5ydxmyjC-WR06xXsqeV-3TgoA75NkA2xQWIrhrK1abxKTz9mz9eMLOV</recordid><startdate>20140101</startdate><enddate>20140101</enddate><creator>Silvetti, Massimo</creator><creator>Nuñez Castellar, Elena</creator><creator>Roger, Clémence</creator><creator>Verguts, Tom</creator><general>Elsevier Inc</general><general>Elsevier</general><general>Elsevier Limited</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7TK</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>LK8</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>M7P</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>RC3</scope><scope>7X8</scope><scope>7QO</scope></search><sort><creationdate>20140101</creationdate><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><author>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>ACC</topic><topic>Accuracy</topic><topic>Adult</topic><topic>Anticipation, Psychological - physiology</topic><topic>Biological and medical sciences</topic><topic>Brain Mapping - methods</topic><topic>Choice Behavior - physiology</topic><topic>Cortex (frontal)</topic><topic>Decision making</topic><topic>Economic models</topic><topic>Electroencephalography - methods</topic><topic>Error correction & detection</topic><topic>Feedback</topic><topic>Female</topic><topic>Frontal Lobe - physiology</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Humans</topic><topic>Male</topic><topic>Medial frontal cortex</topic><topic>Monetary incentives</topic><topic>Neurosciences</topic><topic>Prediction error</topic><topic>Primates</topic><topic>Reinforcement (Psychology)</topic><topic>Reinforcement learning</topic><topic>Reward</topic><topic>Studies</topic><topic>Vertebrates: nervous system and sense organs</topic><topic>Young Adult</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Silvetti, Massimo</creatorcontrib><creatorcontrib>Nuñez Castellar, Elena</creatorcontrib><creatorcontrib>Roger, Clémence</creatorcontrib><creatorcontrib>Verguts, Tom</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Neurosciences Abstracts</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>ProQuest Biological Science Collection</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Psychology Database</collection><collection>Biological Science Database</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>Biotechnology Research Abstracts</collection><jtitle>NeuroImage (Orlando, Fla.)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Silvetti, Massimo</au><au>Nuñez Castellar, Elena</au><au>Roger, Clémence</au><au>Verguts, Tom</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Reward expectation and prediction error in human medial frontal cortex: An EEG study</atitle><jtitle>NeuroImage (Orlando, Fla.)</jtitle><addtitle>Neuroimage</addtitle><date>2014-01-01</date><risdate>2014</risdate><volume>84</volume><spage>376</spage><epage>382</epage><pages>376-382</pages><issn>1053-8119</issn><eissn>1095-9572</eissn><abstract>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors.
•We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</abstract><cop>Amsterdam</cop><pub>Elsevier Inc</pub><pmid>24007806</pmid><doi>10.1016/j.neuroimage.2013.08.058</doi><tpages>7</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1053-8119 |
ispartof | NeuroImage (Orlando, Fla.), 2014-01, Vol.84, p.376-382 |
issn | 1053-8119 1095-9572 |
language | eng |
recordid | cdi_proquest_miscellaneous_1500780550 |
source | MEDLINE; Elsevier ScienceDirect Journals Complete; ProQuest Central UK/Ireland |
subjects | ACC Accuracy Adult Anticipation, Psychological - physiology Biological and medical sciences Brain Mapping - methods Choice Behavior - physiology Cortex (frontal) Decision making Economic models Electroencephalography - methods Error correction & detection Feedback Female Frontal Lobe - physiology Fundamental and applied biological sciences. Psychology Humans Male Medial frontal cortex Monetary incentives Neurosciences Prediction error Primates Reinforcement (Psychology) Reinforcement learning Reward Studies Vertebrates: nervous system and sense organs Young Adult |
title | Reward expectation and prediction error in human medial frontal cortex: An EEG study |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T11%3A48%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Reward%20expectation%20and%20prediction%20error%20in%20human%20medial%20frontal%20cortex:%20An%20EEG%20study&rft.jtitle=NeuroImage%20(Orlando,%20Fla.)&rft.au=Silvetti,%20Massimo&rft.date=2014-01-01&rft.volume=84&rft.spage=376&rft.epage=382&rft.pages=376-382&rft.issn=1053-8119&rft.eissn=1095-9572&rft_id=info:doi/10.1016/j.neuroimage.2013.08.058&rft_dat=%3Cproquest_cross%3E1500780550%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1547314349&rft_id=info:pmid/24007806&rft_els_id=S1053811913009221&rfr_iscdi=true |