A Hadoop-based data management system

The invention discloses a Hadoop-based data management system, and belongs to the technical field of data management. The Hadoop-based data governance system comprises a data source, a data governancerule configuration module, a data governance rule execution module, a data delivery module, a data g...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: LIN GUIXU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a Hadoop-based data management system, and belongs to the technical field of data management. The Hadoop-based data governance system comprises a data source, a data governancerule configuration module, a data governance rule execution module, a data delivery module, a data governance evaluation report module, a log module and an authority management module. The data source configures data required for data mining by inquiring a filtering condition; the data governance rule configuration module selects data in a data source to enter data mining calculation; the data processing rule execution module is used for processing input data according to the data processing rule; and the data delivery module enables the governed data to be matched with the input type of thedata mining model. The Hadoop-based data management system can solve the abnormal conditions of data lack, data redundancy, data errors and the like in the processes of data mining, data calculation and data analysis, and has