Data quality management method and device, equipment and storage medium
The invention belongs to the technical field of data processing, and discloses a data quality management method and device, equipment and a storage medium. The method comprises the following steps: receiving heterogeneous data from different systems; based on the similarity between the heterogeneous...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention belongs to the technical field of data processing, and discloses a data quality management method and device, equipment and a storage medium. The method comprises the following steps: receiving heterogeneous data from different systems; based on the similarity between the heterogeneous data, filtering historical record data in the heterogeneous data to obtain filtered data; when a vacancy attribute exists in the filtered data, performing completion processing on the filtered data based on the importance degree of the vacancy attribute to obtain completion data; based on a preset consistency requirement, correcting the complemented data to obtain consistent data; and when the consistent data passes the accuracy verification, storing the consistent data in the distributed database. By means of the mode, data filtering, data complementing and data consistent processing are conducted on the multi-source heterogeneous data, automatic normalization of the heterogeneous data is achieved, the data proce |
---|