INTEGRITY IN A DATA WAREHOUSE (DWH) OF AN EVENT DRIVEN DISTRIBUTED SYSTEM

A method for data validation and reconciliation of data stored in a data warehouse (DWH) by multiple microservices in communication with the DWH, is provided. The method generally includes receiving, by each microservice, records of data maintained in the DWH, obtaining, by each microservice, corres...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: GABAY, Or, AHARONI, Yaniv, BAKSHAN, Igal, YEDGAR, Tal, ALTONY, Amnon
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A method for data validation and reconciliation of data stored in a data warehouse (DWH) by multiple microservices in communication with the DWH, is provided. The method generally includes receiving, by each microservice, records of data maintained in the DWH, obtaining, by each microservice, corresponding records of data that correspond to the records of data maintained in the DWH, performing, by each microservice, a validation process to validate the records of data maintained in the DWH by comparing the records of data maintained in the DWH with the corresponding records of data, determining, by one or more microservices of the multiple microservices, the comparison indicates discrepancies exist in the records of data maintained in the DWH, and issuing, by the microservices, one or more reconciliation events to remediate the discrepancies which exist in the records of data maintained in the DWH.