Data processing method and device of streaming computing system

The embodiment of the invention discloses a data processing method and device of a streaming computing system. One specific embodiment of the method comprises the following steps: obtaining a confirmation message returned by a downstream processing system of the streaming computing system, wherein t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XING YUE, XIE WEIZHU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention discloses a data processing method and device of a streaming computing system. One specific embodiment of the method comprises the following steps: obtaining a confirmation message returned by a downstream processing system of the streaming computing system, wherein the confirmation message comprises an identifier used for indicating that the downstream processing system completes the processing of the data; positioning a data structure corresponding to the identifier of the downstream data fragment where the processed data is located in the streaming computingsystem, and finding a corresponding upstream data fragment in the data structure according to the identifier of the upstream data fragment where the processed data is located; and traversing and deleting the data of which the position identifier in the found upstream data fragment is not greater than the position identifier of the processed data in the upstream data fragment. According to the embodiment, batch cleaning of