TY - JOUR
T1 - Moving developmental research online
T2 - Comparing in-lab and web-based studies of model-based reinforcement learning
AU - Nussenbaum, Kate
AU - Scheuplein, Maximilian
AU - Phaneuf, Camille V.
AU - Evans, Michael D.
AU - Hartley, Catherine A.
N1 - Publisher Copyright:
© 2020 University of California Press. All rights reserved.
PY - 2020/11/23
Y1 - 2020/11/23
N2 - For years, adult psychological research has benefitted from web-based data collection. There is growing interest in harnessing this approach to facilitate data collection from children and adolescents to address foundational questions about cognitive development. To date, however, few studies have directly tested whether findings from in-lab developmental psychology tasks can be replicated online, particularly in the domain of value-based learning and decision-making. To address this question, we set up a pipeline for online data collection with children, adolescents, and adults, and conducted a replication of Decker et al. (2016). The original in-lab study employed a sequential decision-making paradigm to examine shifts in value-learning strategies from childhood to adulthood. Here, we used the same paradigm in a sample of 151 children (N = 50; ages 8 - 12 years), adolescents (N = 50; ages 13 - 17 years), and adults (N = 51; ages 18 - 25 years) and replicated the main finding that the use of a “model-based” learning strategy increases with age. In addition, we adapted a new index of abstract reasoning (MaRs-IB; Chierchia et al. 2019) for use online, and replicated a key result from Potter et al. (2017), which found that abstract reasoning ability mediated the relation between age and model-based learning. Our re-analyses of two previous in-lab datasets alongside our analysis of our online dataset revealed few qualitative differences across task administrations. These findings suggest that with appropriate precautions, researchers can effectively examine developmental differences in learning computations through unmoderated, online experiments.
AB - For years, adult psychological research has benefitted from web-based data collection. There is growing interest in harnessing this approach to facilitate data collection from children and adolescents to address foundational questions about cognitive development. To date, however, few studies have directly tested whether findings from in-lab developmental psychology tasks can be replicated online, particularly in the domain of value-based learning and decision-making. To address this question, we set up a pipeline for online data collection with children, adolescents, and adults, and conducted a replication of Decker et al. (2016). The original in-lab study employed a sequential decision-making paradigm to examine shifts in value-learning strategies from childhood to adulthood. Here, we used the same paradigm in a sample of 151 children (N = 50; ages 8 - 12 years), adolescents (N = 50; ages 13 - 17 years), and adults (N = 51; ages 18 - 25 years) and replicated the main finding that the use of a “model-based” learning strategy increases with age. In addition, we adapted a new index of abstract reasoning (MaRs-IB; Chierchia et al. 2019) for use online, and replicated a key result from Potter et al. (2017), which found that abstract reasoning ability mediated the relation between age and model-based learning. Our re-analyses of two previous in-lab datasets alongside our analysis of our online dataset revealed few qualitative differences across task administrations. These findings suggest that with appropriate precautions, researchers can effectively examine developmental differences in learning computations through unmoderated, online experiments.
KW - Cognitive development
KW - Decision-making
KW - Online testing
KW - Reinforcement learning
KW - Replication
UR - http://www.scopus.com/inward/record.url?scp=85104843788&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85104843788&partnerID=8YFLogxK
U2 - 10.1525/collabra.17213
DO - 10.1525/collabra.17213
M3 - Article
AN - SCOPUS:85104843788
SN - 2474-7394
VL - 6
JO - Collabra: Psychology
JF - Collabra: Psychology
IS - 1
M1 - 11
ER -