Reward expectation and prediction error in human medial frontal cortex: An EEG study

The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:NeuroImage (Orlando, Fla.) Fla.), 2014-01, Vol.84, p.376-382
Hauptverfasser: Silvetti, Massimo, Nuñez Castellar, Elena, Roger, Clémence, Verguts, Tom
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 382
container_issue
container_start_page 376
container_title NeuroImage (Orlando, Fla.)
container_volume 84
creator Silvetti, Massimo
Nuñez Castellar, Elena
Roger, Clémence
Verguts, Tom
description The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors. •We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.
doi_str_mv 10.1016/j.neuroimage.2013.08.058
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1500780550</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1053811913009221</els_id><sourcerecordid>1500780550</sourcerecordid><originalsourceid>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</originalsourceid><addsrcrecordid>eNqFkV1rFDEUhoMotl39CxIQwZsZ8znJeFfLtgoFQep1yCRnNMtssiYztf33ZrurBW96lYQ85yTveRDClLSU0O7Dpo2w5BS29ge0jFDeEt0SqZ-hU0p62fRSsef7veSNprQ_QWelbAghPRX6JTphghClSXeKbr7Bb5s9hrsduNnOIUVso8e7DD64hyPknDIOEf9ctjbibb2wEx5zinNdXcoz3H3E5xGv11e4zIu_f4VejHYq8Pq4rtD3y_XNxefm-uvVl4vz68aJTs6Ncz1wrjRjVsmBSTvKsaZjYlADEKq8tlLpvmPODdwK6hhztPO-JqIjOM9X6P2h7y6nXwuU2WxDcTBNNkJaiqHyIaaU5GlUdEL0nHNd0bf_oZu05FiD1IZCcSp4JVdIHyiXUykZRrPL1Ue-N5SYvSSzMY-SzF6SIdpUSbX0zfGBZajT_Ff410oF3h0BW5ydxmyjC-WR06xXsqeV-3TgoA75NkA2xQWIrhrK1abxKTz9mz9eMLOV</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1547314349</pqid></control><display><type>article</type><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals Complete</source><source>ProQuest Central UK/Ireland</source><creator>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</creator><creatorcontrib>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</creatorcontrib><description>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors. •We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</description><identifier>ISSN: 1053-8119</identifier><identifier>EISSN: 1095-9572</identifier><identifier>DOI: 10.1016/j.neuroimage.2013.08.058</identifier><identifier>PMID: 24007806</identifier><language>eng</language><publisher>Amsterdam: Elsevier Inc</publisher><subject>ACC ; Accuracy ; Adult ; Anticipation, Psychological - physiology ; Biological and medical sciences ; Brain Mapping - methods ; Choice Behavior - physiology ; Cortex (frontal) ; Decision making ; Economic models ; Electroencephalography - methods ; Error correction &amp; detection ; Feedback ; Female ; Frontal Lobe - physiology ; Fundamental and applied biological sciences. Psychology ; Humans ; Male ; Medial frontal cortex ; Monetary incentives ; Neurosciences ; Prediction error ; Primates ; Reinforcement (Psychology) ; Reinforcement learning ; Reward ; Studies ; Vertebrates: nervous system and sense organs ; Young Adult</subject><ispartof>NeuroImage (Orlando, Fla.), 2014-01, Vol.84, p.376-382</ispartof><rights>2013 Elsevier Inc.</rights><rights>2015 INIST-CNRS</rights><rights>2013.</rights><rights>Copyright Elsevier Limited Jan 1, 2014</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</citedby><cites>FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/1547314349?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,3550,4024,27923,27924,27925,45995,64385,64387,64389,72469</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=28297591$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24007806$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Silvetti, Massimo</creatorcontrib><creatorcontrib>Nuñez Castellar, Elena</creatorcontrib><creatorcontrib>Roger, Clémence</creatorcontrib><creatorcontrib>Verguts, Tom</creatorcontrib><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><title>NeuroImage (Orlando, Fla.)</title><addtitle>Neuroimage</addtitle><description>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors. •We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</description><subject>ACC</subject><subject>Accuracy</subject><subject>Adult</subject><subject>Anticipation, Psychological - physiology</subject><subject>Biological and medical sciences</subject><subject>Brain Mapping - methods</subject><subject>Choice Behavior - physiology</subject><subject>Cortex (frontal)</subject><subject>Decision making</subject><subject>Economic models</subject><subject>Electroencephalography - methods</subject><subject>Error correction &amp; detection</subject><subject>Feedback</subject><subject>Female</subject><subject>Frontal Lobe - physiology</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Humans</subject><subject>Male</subject><subject>Medial frontal cortex</subject><subject>Monetary incentives</subject><subject>Neurosciences</subject><subject>Prediction error</subject><subject>Primates</subject><subject>Reinforcement (Psychology)</subject><subject>Reinforcement learning</subject><subject>Reward</subject><subject>Studies</subject><subject>Vertebrates: nervous system and sense organs</subject><subject>Young Adult</subject><issn>1053-8119</issn><issn>1095-9572</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNqFkV1rFDEUhoMotl39CxIQwZsZ8znJeFfLtgoFQep1yCRnNMtssiYztf33ZrurBW96lYQ85yTveRDClLSU0O7Dpo2w5BS29ge0jFDeEt0SqZ-hU0p62fRSsef7veSNprQ_QWelbAghPRX6JTphghClSXeKbr7Bb5s9hrsduNnOIUVso8e7DD64hyPknDIOEf9ctjbibb2wEx5zinNdXcoz3H3E5xGv11e4zIu_f4VejHYq8Pq4rtD3y_XNxefm-uvVl4vz68aJTs6Ncz1wrjRjVsmBSTvKsaZjYlADEKq8tlLpvmPODdwK6hhztPO-JqIjOM9X6P2h7y6nXwuU2WxDcTBNNkJaiqHyIaaU5GlUdEL0nHNd0bf_oZu05FiD1IZCcSp4JVdIHyiXUykZRrPL1Ue-N5SYvSSzMY-SzF6SIdpUSbX0zfGBZajT_Ff410oF3h0BW5ydxmyjC-WR06xXsqeV-3TgoA75NkA2xQWIrhrK1abxKTz9mz9eMLOV</recordid><startdate>20140101</startdate><enddate>20140101</enddate><creator>Silvetti, Massimo</creator><creator>Nuñez Castellar, Elena</creator><creator>Roger, Clémence</creator><creator>Verguts, Tom</creator><general>Elsevier Inc</general><general>Elsevier</general><general>Elsevier Limited</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7TK</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>LK8</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>M7P</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>RC3</scope><scope>7X8</scope><scope>7QO</scope></search><sort><creationdate>20140101</creationdate><title>Reward expectation and prediction error in human medial frontal cortex: An EEG study</title><author>Silvetti, Massimo ; Nuñez Castellar, Elena ; Roger, Clémence ; Verguts, Tom</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c465t-cc9e337822a75b25af5f01624b7be017d8a578962ccb3a41c22c16dd8111fecd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>ACC</topic><topic>Accuracy</topic><topic>Adult</topic><topic>Anticipation, Psychological - physiology</topic><topic>Biological and medical sciences</topic><topic>Brain Mapping - methods</topic><topic>Choice Behavior - physiology</topic><topic>Cortex (frontal)</topic><topic>Decision making</topic><topic>Economic models</topic><topic>Electroencephalography - methods</topic><topic>Error correction &amp; detection</topic><topic>Feedback</topic><topic>Female</topic><topic>Frontal Lobe - physiology</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Humans</topic><topic>Male</topic><topic>Medial frontal cortex</topic><topic>Monetary incentives</topic><topic>Neurosciences</topic><topic>Prediction error</topic><topic>Primates</topic><topic>Reinforcement (Psychology)</topic><topic>Reinforcement learning</topic><topic>Reward</topic><topic>Studies</topic><topic>Vertebrates: nervous system and sense organs</topic><topic>Young Adult</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Silvetti, Massimo</creatorcontrib><creatorcontrib>Nuñez Castellar, Elena</creatorcontrib><creatorcontrib>Roger, Clémence</creatorcontrib><creatorcontrib>Verguts, Tom</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Neurosciences Abstracts</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>ProQuest Biological Science Collection</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Psychology Database</collection><collection>Biological Science Database</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>Biotechnology Research Abstracts</collection><jtitle>NeuroImage (Orlando, Fla.)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Silvetti, Massimo</au><au>Nuñez Castellar, Elena</au><au>Roger, Clémence</au><au>Verguts, Tom</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Reward expectation and prediction error in human medial frontal cortex: An EEG study</atitle><jtitle>NeuroImage (Orlando, Fla.)</jtitle><addtitle>Neuroimage</addtitle><date>2014-01-01</date><risdate>2014</risdate><volume>84</volume><spage>376</spage><epage>382</epage><pages>376-382</pages><issn>1053-8119</issn><eissn>1095-9572</eissn><abstract>The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (reward prediction errors). However, there is a paucity of evidence about the time course of MFC-related activity during reward prediction and prediction error in humans. Here we experimentally investigated this by recording the EEG during a reinforcement learning task. Our results support the hypothesis that human MFC codes for reward prediction during the cue period and for prediction error during the outcome period. Further, reward expectation (cue period) was positively correlated with prediction error (outcome period) in error trials but negatively in correct trials, consistent with updating of reward expectation by prediction error. This demonstrates in humans, like in nonhuman primates, a role of the MFC in the rapid updating of reward expectations through prediction errors. •We hypothesize that human MFC computes reward prediction and prediction error.•We administered a RL task to healthy volunteers while recording EEG.•We extracted MFC signals by means of independent component analysis.•Results confirm that human MFC performs RL processing.</abstract><cop>Amsterdam</cop><pub>Elsevier Inc</pub><pmid>24007806</pmid><doi>10.1016/j.neuroimage.2013.08.058</doi><tpages>7</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1053-8119
ispartof NeuroImage (Orlando, Fla.), 2014-01, Vol.84, p.376-382
issn 1053-8119
1095-9572
language eng
recordid cdi_proquest_miscellaneous_1500780550
source MEDLINE; Elsevier ScienceDirect Journals Complete; ProQuest Central UK/Ireland
subjects ACC
Accuracy
Adult
Anticipation, Psychological - physiology
Biological and medical sciences
Brain Mapping - methods
Choice Behavior - physiology
Cortex (frontal)
Decision making
Economic models
Electroencephalography - methods
Error correction & detection
Feedback
Female
Frontal Lobe - physiology
Fundamental and applied biological sciences. Psychology
Humans
Male
Medial frontal cortex
Monetary incentives
Neurosciences
Prediction error
Primates
Reinforcement (Psychology)
Reinforcement learning
Reward
Studies
Vertebrates: nervous system and sense organs
Young Adult
title Reward expectation and prediction error in human medial frontal cortex: An EEG study
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T11%3A48%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Reward%20expectation%20and%20prediction%20error%20in%20human%20medial%20frontal%20cortex:%20An%20EEG%20study&rft.jtitle=NeuroImage%20(Orlando,%20Fla.)&rft.au=Silvetti,%20Massimo&rft.date=2014-01-01&rft.volume=84&rft.spage=376&rft.epage=382&rft.pages=376-382&rft.issn=1053-8119&rft.eissn=1095-9572&rft_id=info:doi/10.1016/j.neuroimage.2013.08.058&rft_dat=%3Cproquest_cross%3E1500780550%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1547314349&rft_id=info:pmid/24007806&rft_els_id=S1053811913009221&rfr_iscdi=true