Data real-time analysis method and device, equipment and storage medium
The invention discloses a data real-time analysis method and device, computing equipment and a storage medium. According to the technical scheme provided by the invention, newly generated source data is acquired in real time, and the source data is stored in a corresponding classification in a first...
Gespeichert in:
Hauptverfasser: | , , , , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a data real-time analysis method and device, computing equipment and a storage medium. According to the technical scheme provided by the invention, newly generated source data is acquired in real time, and the source data is stored in a corresponding classification in a first storage system according to the type of the source data; according to a configuration file, performing data analysis on the source data in each classification in the first storage system through each execution node to obtain an analysis result; the analysis result is consumed through an engine table, and real-time convergence is carried out according to a preset dimension to obtain a corresponding summary table; and correlating the corresponding source data by using the summary table to obtain a target application report. According to the method, the real-time streaming processing capability can be realized, the extra cost caused by off-line scheduling is reduced, the data processing and analysis are more flexible |
---|