Model-based choices involve prospective neural activity

Bradley B. Doll, Katherine D. Duncan, Dylan A. Simon, Daphna Shohamy, Nathaniel D. Daw

Research output: Contribution to journalArticle

Abstract

Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.

Original languageEnglish (US)
Pages (from-to)767-772
Number of pages6
JournalNature Neuroscience
Volume18
Issue number5
DOIs
StatePublished - Apr 28 2015

ASJC Scopus subject areas

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Model-based choices involve prospective neural activity'. Together they form a unique fingerprint.

  • Cite this

    Doll, B. B., Duncan, K. D., Simon, D. A., Shohamy, D., & Daw, N. D. (2015). Model-based choices involve prospective neural activity. Nature Neuroscience, 18(5), 767-772. https://doi.org/10.1038/nn.3981