Towards integrating workflow and database provenance

Fernando Chirigati; Juliana Freire

doi:10.1007/978-3-642-34222-6_2

Towards integrating workflow and database provenance

Fernando Chirigati, Juliana Freire

Urban Initiative

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

While there has been substantial work on both database and workflow provenance, the two problems have only been examined in isolation. It is widely accepted that the existing models are incompatible. Database provenance is fine-grained and captures changes to tuples in a database. In contrast, workflow provenance is represented at a coarser level and reflects the functional model of workflow systems, which is stateless-each computational step derives a new artifact. In this paper, we propose a new approach to combine database and workflow provenance. We address the mismatch between the different kinds of provenance by using a temporal model which explicitly represents the database states as updates are applied. We discuss how, under this model, reproducibility is obtained for workflows that manipulate databases, and how different queries that straddle the two provenance traces can be evaluated. We also describe a proof-of-concept implementation that integrates a workflow system and a commercial relational database.

Original language	English (US)
Title of host publication	Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers
Pages	11-23
Number of pages	13
DOIs	https://doi.org/10.1007/978-3-642-34222-6_2
State	Published - 2012
Event	4th International Provenance and Annotation Workshop, IPAW 2012 - Santa Barbara, CA, United States Duration: Jun 19 2012 → Jun 21 2012

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	7525 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	4th International Provenance and Annotation Workshop, IPAW 2012
Country/Territory	United States
City	Santa Barbara, CA
Period	6/19/12 → 6/21/12

Keywords

Database Provenance
Reproducibility
Workflow Provenance

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-642-34222-6_2

Cite this

Chirigati, F., & Freire, J. (2012). Towards integrating workflow and database provenance. In Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers (pp. 11-23). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7525 LNCS). https://doi.org/10.1007/978-3-642-34222-6_2

Towards integrating workflow and database provenance. / Chirigati, Fernando; Freire, Juliana.
Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers. 2012. p. 11-23 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7525 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chirigati, F & Freire, J 2012, Towards integrating workflow and database provenance. in Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7525 LNCS, pp. 11-23, 4th International Provenance and Annotation Workshop, IPAW 2012, Santa Barbara, CA, United States, 6/19/12. https://doi.org/10.1007/978-3-642-34222-6_2

Chirigati F, Freire J. Towards integrating workflow and database provenance. In Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers. 2012. p. 11-23. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-34222-6_2

Chirigati, Fernando ; Freire, Juliana. / Towards integrating workflow and database provenance. Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers. 2012. pp. 11-23 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{178b2d2c1f434b1c965c454dff921c26,

title = "Towards integrating workflow and database provenance",

abstract = "While there has been substantial work on both database and workflow provenance, the two problems have only been examined in isolation. It is widely accepted that the existing models are incompatible. Database provenance is fine-grained and captures changes to tuples in a database. In contrast, workflow provenance is represented at a coarser level and reflects the functional model of workflow systems, which is stateless-each computational step derives a new artifact. In this paper, we propose a new approach to combine database and workflow provenance. We address the mismatch between the different kinds of provenance by using a temporal model which explicitly represents the database states as updates are applied. We discuss how, under this model, reproducibility is obtained for workflows that manipulate databases, and how different queries that straddle the two provenance traces can be evaluated. We also describe a proof-of-concept implementation that integrates a workflow system and a commercial relational database.",

keywords = "Database Provenance, Reproducibility, Workflow Provenance",

author = "Fernando Chirigati and Juliana Freire",

year = "2012",

doi = "10.1007/978-3-642-34222-6_2",

language = "English (US)",

isbn = "9783642342219",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "11--23",

booktitle = "Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers",

note = "4th International Provenance and Annotation Workshop, IPAW 2012 ; Conference date: 19-06-2012 Through 21-06-2012",

}

TY - GEN

T1 - Towards integrating workflow and database provenance

AU - Chirigati, Fernando

AU - Freire, Juliana

PY - 2012

Y1 - 2012

N2 - While there has been substantial work on both database and workflow provenance, the two problems have only been examined in isolation. It is widely accepted that the existing models are incompatible. Database provenance is fine-grained and captures changes to tuples in a database. In contrast, workflow provenance is represented at a coarser level and reflects the functional model of workflow systems, which is stateless-each computational step derives a new artifact. In this paper, we propose a new approach to combine database and workflow provenance. We address the mismatch between the different kinds of provenance by using a temporal model which explicitly represents the database states as updates are applied. We discuss how, under this model, reproducibility is obtained for workflows that manipulate databases, and how different queries that straddle the two provenance traces can be evaluated. We also describe a proof-of-concept implementation that integrates a workflow system and a commercial relational database.

AB - While there has been substantial work on both database and workflow provenance, the two problems have only been examined in isolation. It is widely accepted that the existing models are incompatible. Database provenance is fine-grained and captures changes to tuples in a database. In contrast, workflow provenance is represented at a coarser level and reflects the functional model of workflow systems, which is stateless-each computational step derives a new artifact. In this paper, we propose a new approach to combine database and workflow provenance. We address the mismatch between the different kinds of provenance by using a temporal model which explicitly represents the database states as updates are applied. We discuss how, under this model, reproducibility is obtained for workflows that manipulate databases, and how different queries that straddle the two provenance traces can be evaluated. We also describe a proof-of-concept implementation that integrates a workflow system and a commercial relational database.

KW - Database Provenance

KW - Reproducibility

KW - Workflow Provenance

UR - http://www.scopus.com/inward/record.url?scp=84868294169&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84868294169&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-34222-6_2

DO - 10.1007/978-3-642-34222-6_2

M3 - Conference contribution

AN - SCOPUS:84868294169

SN - 9783642342219

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 11

EP - 23

BT - Provenance and Annotation of Data and Processes - 4th International Provenance and Annotation Workshop, IPAW 2012, Revised Selected Papers

T2 - 4th International Provenance and Annotation Workshop, IPAW 2012

Y2 - 19 June 2012 through 21 June 2012

ER -

Towards integrating workflow and database provenance

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this