Data quality verification method and device

The invention discloses a data quality verification method and device, and the method comprises the steps: carrying out the data processing according to a task node in a data processing link, and obtaining a data processing result. And performing quality verification on the data processing result ac...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WANG LEI, SUN GUFEI, CHEN ZHIYUAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a data quality verification method and device, and the method comprises the steps: carrying out the data processing according to a task node in a data processing link, and obtaining a data processing result. And performing quality verification on the data processing result according to a quality verification rule to obtain a quality verification result. And when the quality verification result violates a first verification rule in the quality verification rules, executing the next task node. When the quality verification result violates a second verification rule in the quality verification rules, the task node is blocked, and the rule threshold value of the second verification rule is larger than the rule threshold value of the first verification rule. Through the blocking strategies corresponding to different checking rules in the quality checking rules, a one-step blocking mode is avoided, the influence on the downstream data is reduced, the downstream data can be normally subjected