Stream processing framework-based data processing method and apparatus
The invention provides a stream processing framework-based data processing method and apparatus. The data processing method comprises the steps of acquiring log information according to a preset acquisition rule, and obtaining pre-configured analysis rule and statistics rule corresponding to the log...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a stream processing framework-based data processing method and apparatus. The data processing method comprises the steps of acquiring log information according to a preset acquisition rule, and obtaining pre-configured analysis rule and statistics rule corresponding to the log information; and performing analysis processing on the log information according to the analysis rule through a stream processing framework to obtain an analysis result of the log information, and performing statistics processing on the analysis result according to the statistics rule to obtain a statistics result of the log information. According to the stream processing framework-based data processing method and apparatus provided by the invention, the log information is acquired according to the acquisition rule, and the log information is subjected to the analysis processing according to the analysis rule and the statistics rule by utilizing the stream processing framework, so that the real-time property of lo |
---|