Log data processing method and device based on stream application, equipment and medium
The invention provides a log data processing method and device based on a stream application, equipment and a medium. The method comprises the steps of obtaining initial log data and a theme of the initial log data; sending the initial log data to a target message queue of the message middleware acc...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a log data processing method and device based on a stream application, equipment and a medium. The method comprises the steps of obtaining initial log data and a theme of the initial log data; sending the initial log data to a target message queue of the message middleware according to the theme of the initial log data; loading a target message queue by using the stream application, reading the initial log data in the target message queue, determining the target log data, and determining target rules based on a preset rule database, the theme of the initial log data, the stream application type and the target rules being in one-to-one correspondence, and the preset rule database storing a plurality of target rules; and processing the target log data according to the target rule based on the stream application, and storing the processed log data in a preset storage database. The real-time performance of log data processing is guaranteed, and meanwhile high availability and universality o |
---|