Validation of ETL pipeline using assert data

A computing system is provided, which is configured to instantiate a testing environment, define an extract, transform, load (ETL) pipeline within the testing environment, generate a test data set to be inputted into the ETL pipeline, generate assert data predicting an output of the ETL pipeline bas...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Drollinger, Robert Aron, Getty, Kyle Kraeger, Doshi, Rushabh Anilkumar
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A computing system is provided, which is configured to instantiate a testing environment, define an extract, transform, load (ETL) pipeline within the testing environment, generate a test data set to be inputted into the ETL pipeline, generate assert data predicting an output of the ETL pipeline based on the generated test data set, input the test data set into the ETL pipeline to generate output data, compare the assert data to the output data, and validate the output data using the assert data to generate validation data.