Application report form realization method and application report form realization equipment based on Hadoop platform and storage medium
The invention discloses an application report form realization method based on a Hadoop platform. The method includes: carrying out extraction and conversion processing on source data stored in an HDFS, then loading the data into a data form of a near-source layer of a data warehouse, and extracting...
Gespeichert in:
Hauptverfasser: | , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses an application report form realization method based on a Hadoop platform. The method includes: carrying out extraction and conversion processing on source data stored in an HDFS, then loading the data into a data form of a near-source layer of a data warehouse, and extracting data therefrom for data quality verification; if verification is successful, carrying out conversion processing on the extracted data, then loading the data into a data form of a model layer of the data warehouse, and then extracting data therefrom for data quality verification; if verification issuccessful, carrying out conversion processing on the extracted data, and then loading the data into a data form of an application layer of the data warehouse; and carrying out data quality verification on data in the data form of the application layer, if verification is successful, using the data form of the application layer as a to-be-reported application report form, and otherwise, issuing averification anomaly alarm |
---|