Data dependency driven task processing device, method and equipment

The invention provides a data dependency driven task processing device, method and equipment, and relates to the field of data processing, in particular to the field of task scheduling and processing. The task processing device comprises a data acquisition module used for acquiring related data of a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WANG LEI, SONG JIANWEI, YE GUANGZHEN, PAN ZESHI, TIAN SHUYI, XU ZIHAO, XU MINZI
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data dependency driven task processing device, method and equipment, and relates to the field of data processing, in particular to the field of task scheduling and processing. The task processing device comprises a data acquisition module used for acquiring related data of a target task; the construction module is used for constructing a composition primitive and a data primitive based on the related data; the creating module is used for creating a logic diagram based on the composition primitive and the data primitive; the generation module is used for generating a physical diagram based on the logic diagram; the compiling module is used for carrying out graph compiling on the physical graph to obtain a target physical plan; and the execution module is used for mapping a plurality of tasks in the target physical plan to a plurality of processing units so as to execute the target task. 本公开提供了一种数据依赖驱动的任务处理装置、方法和设备,涉及数据处理领域,尤其涉及任务调度和处理领域。任务处理装置包括:数据获取模块,用于获取目标任务的相关数据;构建模块,用于基于相关数据构建构图原语