Data processing method and device of streaming computing system
The embodiment of the invention discloses a data processing method and device of a streaming computing system. One specific embodiment of the method comprises the following steps: obtaining a confirmation message returned by a downstream processing system of the streaming computing system, wherein t...
Gespeichert in:
Hauptverfasser: | , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The embodiment of the invention discloses a data processing method and device of a streaming computing system. One specific embodiment of the method comprises the following steps: obtaining a confirmation message returned by a downstream processing system of the streaming computing system, wherein the confirmation message comprises an identifier used for indicating that the downstream processing system completes the processing of the data; positioning a data structure corresponding to the identifier of the downstream data fragment where the processed data is located in the streaming computingsystem, and finding a corresponding upstream data fragment in the data structure according to the identifier of the upstream data fragment where the processed data is located; and traversing and deleting the data of which the position identifier in the found upstream data fragment is not greater than the position identifier of the processed data in the upstream data fragment. According to the embodiment, batch cleaning of |
---|