Data scheduling method and device

The invention provides a data scheduling method and device. The method comprises the steps that scheduling tags are added to source data according to predetermined requirements, wherein the scheduling tags are used for recognizing function and processing duration requirements of the source data; and...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: TIAN PENGWEI, LIANG DONG, QU XIUYUN, LUO HONG, JIANG CHUAN, MAO YI
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data scheduling method and device. The method comprises the steps that scheduling tags are added to source data according to predetermined requirements, wherein the scheduling tags are used for recognizing function and processing duration requirements of the source data; and the source data is distributed to corresponding target data processing frameworks according to the scheduling tags. Through the data scheduling method and device, the data can be scheduled to different data processing frameworks for data processing according to the function and processing duration requirements of the data, it is guaranteed that the data can be correctly distributed to the corresponding target big data processing frames, and therefore the big data processing rate is increased. 本发明提供了种数据调度的方法及装置。所述方法包括:将源数据按照预定要求添加调度标签,所述调度标签用于识别所述源数据的功能和处理时长要求;根据所述调度标签将所述源数据分派到对应的目标数据处理框架。本发明能够根据数据的功能和处理时长要求调度到不同的数据处理架构进行数据处理,保证了数据可以被正确地分派到目标大数据处理框架,从而提高大数据处理速率。