Data real-time analysis method and device, equipment and storage medium

The invention discloses a data real-time analysis method and device, computing equipment and a storage medium. According to the technical scheme provided by the invention, newly generated source data is acquired in real time, and the source data is stored in a corresponding classification in a first...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WAN RENHUI, FENG XIAOJIE, LING JIMIN, FENG CHAO, LIANG TONG, ZHOU JIE, WANG QIN, CHEN YANAN, YANG JIAN, LI SHA, XIN WEIYI, LIU YU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a data real-time analysis method and device, computing equipment and a storage medium. According to the technical scheme provided by the invention, newly generated source data is acquired in real time, and the source data is stored in a corresponding classification in a first storage system according to the type of the source data; according to a configuration file, performing data analysis on the source data in each classification in the first storage system through each execution node to obtain an analysis result; the analysis result is consumed through an engine table, and real-time convergence is carried out according to a preset dimension to obtain a corresponding summary table; and correlating the corresponding source data by using the summary table to obtain a target application report. According to the method, the real-time streaming processing capability can be realized, the extra cost caused by off-line scheduling is reduced, the data processing and analysis are more flexible