Prevention science and child/youth development: Randomized explanatory trials for integrating theory, method, and analysis in program evaluation

Research output: Contribution to journalArticle

Abstract

We describe randomized explanatory trials (RETs), a framework for evaluating interventions to prevent adolescent problem behaviors. The approach maps intervention components onto hypothesized mediators of program effects and then uses structural equation modeling to evaluate whether the program changed those mediators and if assumptions of mediator relevance are viable. We review and explain key concepts related to theoretical issues of choosing and conceptualizing mediators, mapping structural relations among mediators, considering cascading effects, and incorporating theories of treatment duration and decay. We also explore methodological issues, including the choice of time intervals between assessments, the use of instrumental variables, methods for dealing with measurement error, and sample-size planning. In addition, we discuss analytic issues including use of structural equation modeling rather than ANOVA, ANCOVA and logistic/OLS regression; how to handle large numbers of mediators; incorporating covariates; use of per-protocol vs. intent-to-treat analyses; quantifying and testing mediation; and use of causal inference approaches to mediation. Because RETs can identify program components that are successful in bringing about change and why— providing more useful evaluations than outcome-only designs—we argue that RETs rather than randomized controlled trials should be the gold standard for program evaluation.

Original languageEnglish (US)
Pages (from-to)651-687
Number of pages37
JournalJournal of the Society for Social Work and Research
Volume9
Issue number4
DOIs
StatePublished - Dec 1 2018

Keywords

  • Adolescent problem behavior
  • Randomized trials
  • Youth development

ASJC Scopus subject areas

  • Social Sciences (miscellaneous)
  • Sociology and Political Science

Fingerprint Dive into the research topics of 'Prevention science and child/youth development: Randomized explanatory trials for integrating theory, method, and analysis in program evaluation'. Together they form a unique fingerprint.

Cite this