A survey on collecting, managing, and analyzing provenance from scripts

João Felipe Pimentel, Juliana Freire, Leonardo Murta, Vanessa Braganholo

Research output: Contribution to journalReview articlepeer-review

Abstract

Scripts are widely used to design and run scientific experiments. Scripting languages are easy to learn and use, and they allow complex tasks to be specified and executed in fewer steps than with traditional programming languages. However, they also have important limitations for reproducibility and data management. As experiments are iteratively refined, it is challenging to reason about each experiment run (or trial), to keep track of the association between trials and experiment instances as well as the differences across trials, and to connect results to specific input data and parameters. Approaches have been proposed that address these limitations by collecting, managing, and analyzing the provenance of scripts. In this article, we survey the state of the art in provenance for scripts. We have identified the approaches by following an exhaustive protocol of forward and backward literature snowballing. Based on a detailed study, we propose a taxonomy and classify the approaches using this taxonomy.

Original languageEnglish (US)
Article number47
JournalACM Computing Surveys
Volume52
Issue number3
DOIs
StatePublished - Jun 2019

Keywords

  • Analyzing
  • Collecting
  • Managing
  • Provenance
  • Scripts
  • Survey

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'A survey on collecting, managing, and analyzing provenance from scripts'. Together they form a unique fingerprint.

Cite this