Data scheduling method and device
The invention provides a data scheduling method and device. The method comprises the steps that scheduling tags are added to source data according to predetermined requirements, wherein the scheduling tags are used for recognizing function and processing duration requirements of the source data; and...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a data scheduling method and device. The method comprises the steps that scheduling tags are added to source data according to predetermined requirements, wherein the scheduling tags are used for recognizing function and processing duration requirements of the source data; and the source data is distributed to corresponding target data processing frameworks according to the scheduling tags. Through the data scheduling method and device, the data can be scheduled to different data processing frameworks for data processing according to the function and processing duration requirements of the data, it is guaranteed that the data can be correctly distributed to the corresponding target big data processing frames, and therefore the big data processing rate is increased.
本发明提供了种数据调度的方法及装置。所述方法包括:将源数据按照预定要求添加调度标签,所述调度标签用于识别所述源数据的功能和处理时长要求;根据所述调度标签将所述源数据分派到对应的目标数据处理框架。本发明能够根据数据的功能和处理时长要求调度到不同的数据处理架构进行数据处理,保证了数据可以被正确地分派到目标大数据处理框架,从而提高大数据处理速率。 |
---|