Model-based influences on humans' choices and striatal prediction errors

Nathaniel D. Daw, Samuel J. Gershman, Ben Seymour, Peter Dayan, Raymond J. Dolan

Research output: Contribution to journalArticle

Abstract

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making.

Original languageEnglish (US)
Pages (from-to)1204-1215
Number of pages12
JournalNeuron
Volume69
Issue number6
DOIs
StatePublished - Mar 24 2011

ASJC Scopus subject areas

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Model-based influences on humans' choices and striatal prediction errors'. Together they form a unique fingerprint.

  • Cite this

    Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron, 69(6), 1204-1215. https://doi.org/10.1016/j.neuron.2011.02.027