Data quality governance system and method based on message bus
The invention relates to a data quality governance system based on a message bus. The system performs the steps of receiving power monitoring data sent by a plurality of data sending ends through themessage bus and stored in a classified mode; determining a power monitoring data quality evaluation i...
Gespeichert in:
Hauptverfasser: | , , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to a data quality governance system based on a message bus. The system performs the steps of receiving power monitoring data sent by a plurality of data sending ends through themessage bus and stored in a classified mode; determining a power monitoring data quality evaluation index, and constructing a data quality rule verification library; clustering the power monitoring data by adopting a k-means clustering method optimized on the basis of a grey wolf longhorn beard search algorithm, and dividing the power monitoring data into a plurality of data subsets; for each datasubset, carrying out accuracy evaluation through an LOF abnormal value detection algorithm, and carrying out integrity, consistency, availability and real-time evaluation through data quality rule verification; and calculating the weight of each evaluation index through an improved analytic hierarchy process, and calculating a comprehensive evaluation result of the power monitoring data quality.According to the system, th |
---|