Method and device for processing data among workflow scheduling engine nodes, equipment and medium
The invention relates to a workflow scheduling engine inter-node data processing method and device, equipment and a medium, and the method comprises the steps: developing and designing a node data transmission information table for each calculation node participating in calculation in a workflow, an...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to a workflow scheduling engine inter-node data processing method and device, equipment and a medium, and the method comprises the steps: developing and designing a node data transmission information table for each calculation node participating in calculation in a workflow, and dynamically storing all input and output data flow information which is set by a user and is related to the node; and the workflow node tasks are persisted in the database along with the storage of the workflow node tasks. Besides, a pre-execution preparation stage is designed for execution of each node, and the target node of the data stream can collect data required during execution of the target node according to the node data transmission information table at the stage and apply the collected data to subsequent execution steps. The coupling degree of workflow and data flow functions in the system is reduced, cross-node data transmission in the directed acyclic graph of the workflow engine can be efficiently r |
---|