Advanced Reinforcement Learning

Nathaniel D. Daw

Research output: Chapter in Book/Report/Conference proceedingChapter


This chapter reviews issues of current research in reinforcement learning theories and their neural substrates. We consider how the formal constructs of states, actions, and rewards that these theories describe can be understood to map onto counterparts experienced by biological organisms learning in the real world. In each case, this correspondence involves significant difficulties. However, elaborated theoretical accounts from computer science clarify, in each case, how to extend these theories to more realistic circumstances while still preserving the core prediction error-driven learning mechanism that has been prominent in neuroeconomic accounts.

Original languageEnglish (US)
Title of host publicationNeuroeconomics
Subtitle of host publicationDecision Making and the Brain: Second Edition
PublisherElsevier Inc.
Number of pages22
ISBN (Print)9780124160088
StatePublished - Sep 2013


  • Dopamine
  • Hierarchical reinforcement learning
  • Reinforcement learning
  • Uncertainty

ASJC Scopus subject areas

  • General Neuroscience


Dive into the research topics of 'Advanced Reinforcement Learning'. Together they form a unique fingerprint.

Cite this