A recurrent network model of planning explains hippocampal replay and human behavior

Kristopher T. Jensen, Guillaume Hennequin, Marcelo G. Mattar

Research output: Contribution to journalArticlepeer-review

Abstract

When faced with a novel situation, people often spend substantial periods of time contemplating possible futures. For such planning to be rational, the benefits to behavior must compensate for the time spent thinking. Here, we capture these features of behavior by developing a neural network model where planning itself is controlled by the prefrontal cortex. This model consists of a meta-reinforcement learning agent augmented with the ability to plan by sampling imagined action sequences from its own policy, which we call ‘rollouts’. In a spatial navigation task, the agent learns to plan when it is beneficial, which provides a normative explanation for empirical variability in human thinking times. Additionally, the patterns of policy rollouts used by the artificial agent closely resemble patterns of rodent hippocampal replays. Our work provides a theory of how the brain could implement planning through prefrontal–hippocampal interactions, where hippocampal replays are triggered by—and adaptively affect—prefrontal dynamics.

Original languageEnglish (US)
JournalNature Neuroscience
DOIs
StateAccepted/In press - 2024

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'A recurrent network model of planning explains hippocampal replay and human behavior'. Together they form a unique fingerprint.

Cite this