Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium

The invention discloses an application report form realization method based on a Hadoop platform. The method includes: carrying out extraction and conversion processing on source data stored in an HDFS, then loading the data into a data form of a near-source layer of a data warehouse, and extracting...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XIAN BINGHONG, XIA JIA, ZHOU DONG, WANG YANAN, WEI XIAOSHENG, LI JING, XIAO HEBING, WANG XINYU, LI CHAOYANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an application report form realization method based on a Hadoop platform. The method includes: carrying out extraction and conversion processing on source data stored in an HDFS, then loading the data into a data form of a near-source layer of a data warehouse, and extracting data therefrom for data quality verification; if verification is successful, carrying out conversion processing on the extracted data, then loading the data into a data form of a model layer of the data warehouse, and then extracting data therefrom for data quality verification; if verification issuccessful, carrying out conversion processing on the extracted data, and then loading the data into a data form of an application layer of the data warehouse; and carrying out data quality verification on data in the data form of the application layer, if verification is successful, using the data form of the application layer as a to-be-reported application report form, and otherwise, issuing averification anomaly alarm