Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Separate encoding of model-based and model-free valuations in the human brain
 
research article

Separate encoding of model-based and model-free valuations in the human brain

Beierholm, Ulrik R.
•
Anen, Cedric
•
Quartz, Steven
Show more
2011
Neuroimage

Behavioral studies have long shown that humans solve problems in two ways, one intuitive and fast (System 1, model-free), and the other reflective and slow (System 2, model-based). The neurobiological basis of dual process problem solving remains unknown due to challenges of separating activation in concurrent systems. We present a novel neuroeconomic task that predicts distinct subjective valuation and updating signals corresponding to these two systems. We found two concurrent value signals in human prefrontal cortex: a System 1 model-free reinforcement signal and a System 2 model-based Bayesian signal. We also found a System 1 updating signal in striatal areas and a System 2 updating signal in lateral prefrontal cortex. Further, signals in prefrontal cortex preceded choices that are optimal according to either updating principle, while signals in anterior cingulate cortex and globus pallidus preceded deviations from optimal choice for reinforcement learning. These deviations tended to occur when uncertainty regarding optimal values was highest, suggesting that disagreement between dual systems is mediated by uncertainty rather than conflict, confirming recent theoretical proposals. (C) 2011 Elsevier Inc. All rights reserved.

  • Details
  • Metrics
Type
research article
DOI
10.1016/j.neuroimage.2011.06.071
Web of Science ID

WOS:000294940700028

Author(s)
Beierholm, Ulrik R.
Anen, Cedric
Quartz, Steven
Bossaerts, Peter  
Date Issued

2011

Publisher

Elsevier

Published in
Neuroimage
Volume

58

Start page

955

End page

962

Subjects

Dual systems

•

Reinforcement learning

•

Bayesian inference

•

Striatum

•

vmPFC

•

Decision making

•

Orbitofrontal Cortex

•

Decision-Making

•

Subjective Value

•

Systems

•

Uncertainty

•

Inference

•

Judgment

•

Rewards

•

Frames

•

Biases

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SFI-PB  
Available on Infoscience
December 16, 2011
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/73545
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés