Short-term gains, long-term pains: How cues about state aid learning in dynamic environments

Todd M. Gureckis, Bradley C. Love

Research output: Contribution to journalArticle

Abstract

Successful investors seeking returns, animals foraging for food, and pilots controlling aircraft all must take into account how their current decisions will impact their future standing. One challenge facing decision makers is that options that appear attractive in the short-term may not turn out best in the long run. In this paper, we explore human learning in a dynamic decision making task which places short- and long-term rewards in conflict. Our goal in these studies was to evaluate how people's mental representation of a task affects their ability to discover an optimal decision strategy. We find that perceptual cues that readily align with the underlying state of the task environment help people overcome the impulsive appeal of short-term rewards. Our experimental manipulations, predictions, and analyses are motivated by current work in reinforcement learning which details how learners value delayed outcomes in sequential tasks and the importance that "state" identification plays in effective learning.

Original languageEnglish (US)
Pages (from-to)293-313
Number of pages21
JournalCognition
Volume113
Issue number3
DOIs
StatePublished - Dec 2009

Keywords

  • Decision making
  • Dynamic control task
  • Learning
  • Q-learning
  • Reinforcement learning
  • Self-control
  • State
  • Temporal difference
  • Temporal discounting

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Language and Linguistics
  • Developmental and Educational Psychology
  • Linguistics and Language
  • Cognitive Neuroscience

Fingerprint Dive into the research topics of 'Short-term gains, long-term pains: How cues about state aid learning in dynamic environments'. Together they form a unique fingerprint.

  • Cite this