psiTurk: An open-source framework for conducting replicable behavioral experiments online

Todd M. Gureckis, Jay Martin, John McDonnell, Alexander S. Rich, Doug Markant, Anna Coenen, David Halpern, Jessica B. Hamrick, Patricia Chan

Research output: Contribution to journalArticlepeer-review

Abstract

Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps researchers develop experiment designs which can be conducted over the Internet. The tool primarily interfaces with Amazon’s Mechanical Turk, a popular crowd-sourcing labor market. This paper describes the basic architecture of the system and introduces new users to the overall goals. psiTurk aims to reduce the technical hurdles for researchers developing online experiments while improving the transparency and collaborative nature of the behavioral sciences.

Original languageEnglish (US)
Pages (from-to)829-842
Number of pages14
JournalBehavior Research Methods
Volume48
Issue number3
DOIs
StatePublished - Sep 1 2016

Keywords

  • Amazon Mechanical Turk
  • Internet experiments
  • Online experiments
  • Open science
  • psiTurk

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • Psychology (miscellaneous)
  • Psychology(all)

Fingerprint Dive into the research topics of 'psiTurk: An open-source framework for conducting replicable behavioral experiments online'. Together they form a unique fingerprint.

Cite this