Log data processing method and device based on stream application, equipment and medium

The invention provides a log data processing method and device based on a stream application, equipment and a medium. The method comprises the steps of obtaining initial log data and a theme of the initial log data; sending the initial log data to a target message queue of the message middleware acc...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: HOU SHUDONG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a log data processing method and device based on a stream application, equipment and a medium. The method comprises the steps of obtaining initial log data and a theme of the initial log data; sending the initial log data to a target message queue of the message middleware according to the theme of the initial log data; loading a target message queue by using the stream application, reading the initial log data in the target message queue, determining the target log data, and determining target rules based on a preset rule database, the theme of the initial log data, the stream application type and the target rules being in one-to-one correspondence, and the preset rule database storing a plurality of target rules; and processing the target log data according to the target rule based on the stream application, and storing the processed log data in a preset storage database. The real-time performance of log data processing is guaranteed, and meanwhile high availability and universality o