Data quality management method and device, equipment and storage medium

The invention belongs to the technical field of data processing, and discloses a data quality management method and device, equipment and a storage medium. The method comprises the following steps: receiving heterogeneous data from different systems; based on the similarity between the heterogeneous...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG WEIMOU, NIE CONG, CHEN QIN, HOU FANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention belongs to the technical field of data processing, and discloses a data quality management method and device, equipment and a storage medium. The method comprises the following steps: receiving heterogeneous data from different systems; based on the similarity between the heterogeneous data, filtering historical record data in the heterogeneous data to obtain filtered data; when a vacancy attribute exists in the filtered data, performing completion processing on the filtered data based on the importance degree of the vacancy attribute to obtain completion data; based on a preset consistency requirement, correcting the complemented data to obtain consistent data; and when the consistent data passes the accuracy verification, storing the consistent data in the distributed database. By means of the mode, data filtering, data complementing and data consistent processing are conducted on the multi-source heterogeneous data, automatic normalization of the heterogeneous data is achieved, the data proce