Data dependency driven task processing device, method and equipment
The invention provides a data dependency driven task processing device, method and equipment, and relates to the field of data processing, in particular to the field of task scheduling and processing. The task processing device comprises a data acquisition module used for acquiring related data of a...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a data dependency driven task processing device, method and equipment, and relates to the field of data processing, in particular to the field of task scheduling and processing. The task processing device comprises a data acquisition module used for acquiring related data of a target task; the construction module is used for constructing a composition primitive and a data primitive based on the related data; the creating module is used for creating a logic diagram based on the composition primitive and the data primitive; the generation module is used for generating a physical diagram based on the logic diagram; the compiling module is used for carrying out graph compiling on the physical graph to obtain a target physical plan; and the execution module is used for mapping a plurality of tasks in the target physical plan to a plurality of processing units so as to execute the target task.
本公开提供了一种数据依赖驱动的任务处理装置、方法和设备,涉及数据处理领域,尤其涉及任务调度和处理领域。任务处理装置包括:数据获取模块,用于获取目标任务的相关数据;构建模块,用于基于相关数据构建构图原语 |
---|