Reward-based training of recurrent neural networks for cognitive and value-based tasks

H. Francis Song, Guangyu R. Yang, Xiao Jing Wang

Research output: Contribution to journalArticlepeer-review

Abstract

Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal’s internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task.

Original languageEnglish (US)
Article numbere21492
JournaleLife
Volume6
DOIs
StatePublished - Jan 13 2017

ASJC Scopus subject areas

  • Neuroscience(all)
  • Immunology and Microbiology(all)
  • Biochemistry, Genetics and Molecular Biology(all)

Fingerprint Dive into the research topics of 'Reward-based training of recurrent neural networks for cognitive and value-based tasks'. Together they form a unique fingerprint.

Cite this