Data quality governance system and method based on message bus

The invention relates to a data quality governance system based on a message bus. The system performs the steps of receiving power monitoring data sent by a plurality of data sending ends through themessage bus and stored in a classified mode; determining a power monitoring data quality evaluation i...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LI WANG, TAO HANTAO, ZHANG LEI, JIANG ZHIBO, FANG YUHE, LIN QING, LI JIAN, CHEN YUE, WU DAWEI, WANG HAITAO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a data quality governance system based on a message bus. The system performs the steps of receiving power monitoring data sent by a plurality of data sending ends through themessage bus and stored in a classified mode; determining a power monitoring data quality evaluation index, and constructing a data quality rule verification library; clustering the power monitoring data by adopting a k-means clustering method optimized on the basis of a grey wolf longhorn beard search algorithm, and dividing the power monitoring data into a plurality of data subsets; for each datasubset, carrying out accuracy evaluation through an LOF abnormal value detection algorithm, and carrying out integrity, consistency, availability and real-time evaluation through data quality rule verification; and calculating the weight of each evaluation index through an improved analytic hierarchy process, and calculating a comprehensive evaluation result of the power monitoring data quality.According to the system, th