Data processing method and device, equipment and storage medium
The invention provides a data processing method and device, equipment and a storage medium, belongs to the technical field of computers, and particularly relates to the technical field of stream computing, distributed computing, big data and the like. According to the specific implementation scheme,...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a data processing method and device, equipment and a storage medium, belongs to the technical field of computers, and particularly relates to the technical field of stream computing, distributed computing, big data and the like. According to the specific implementation scheme, watermark information corresponding to a job in a preset streaming computing engine is determined, the watermark information comprises a job identifier and a watermark timestamp, and the watermark information is stored in a preset storage system, the watermark information stored in the preset storage system is used for determining a processing starting point of the data stream of the corresponding job when the job in the preset streaming computation engine is recovered. By adopting the technical scheme, when the streaming computing engine normally processes the job, the watermark information containing the job identifier and the watermark timestamp is stored, so that the processing starting point of the data strea |
---|