28 Nov-1 Dec 2022 Paris (France)
Bridging the Gap between Process and Procedural Provenance for Statistical Data
George Alter  1@  , Timothy Mcphillips  2  , Thomas Thelen  3  , Jack Gager  4  , Bertram Ludäscher  2  , Dan Smith  5  , Jeremy Iverson  6  
1 : University of Michigan
2 : University of Illinois at Champaign-Urbana
3 : University of California at Santa Barbara
4 : Metadata Technologies North America
5 : Colectica
6 : Colectica

We show how two models of provenance can work together to answer basic questions about data provenance, such as “What computed variables were affected by values of variable X?” The W3C PROV data model is a standard for describing activities and persons that produce digital artifacts. PROV associates processes with inputs and outputs, but it does not have a way to describe how data are changed within the process. PROV has no language for program components, like mathematical expressions or joining data tables. Structured Data Transformation Language (SDTL) provides machine-actionable representations of data transformation commands in the five most widely-used statistical analysis applications. SDTL is a procedural language in which commands are executed sequentially. Thus, SDTL describes the inner workings of programs that are black boxes in PROV. However, SDTL is detailed and verbose, and simple queries can be very complicated in SDTL. Combining PROV and SDTL allows us to answer questions about data preparation and management at levels not available in PROV. Our bridge between PROV and SDTL rests on two pillars: ProvONE, an extension of PROV, and Structured Data Transformation History (SDTH), a simplified view of SDTL.


Online user: 2 Privacy
Loading...