Data processing method and device, equipment and storage medium

The invention provides a data processing method and device, equipment and a storage medium, belongs to the technical field of computers, and particularly relates to the technical field of stream computing, distributed computing, big data and the like. According to the specific implementation scheme,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: LUO SHAOJUN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data processing method and device, equipment and a storage medium, belongs to the technical field of computers, and particularly relates to the technical field of stream computing, distributed computing, big data and the like. According to the specific implementation scheme, watermark information corresponding to a job in a preset streaming computing engine is determined, the watermark information comprises a job identifier and a watermark timestamp, and the watermark information is stored in a preset storage system, the watermark information stored in the preset storage system is used for determining a processing starting point of the data stream of the corresponding job when the job in the preset streaming computation engine is recovered. By adopting the technical scheme, when the streaming computing engine normally processes the job, the watermark information containing the job identifier and the watermark timestamp is stored, so that the processing starting point of the data strea