Batch task scheduling method and system in distributed system
The invention discloses a batch task scheduling method and system in a distributed system, and the method comprises the steps that a task scheduler determines the total number M of fragments of a taskaccording to the online condition of an application server in a distributed application system; the...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a batch task scheduling method and system in a distributed system, and the method comprises the steps that a task scheduler determines the total number M of fragments of a taskaccording to the online condition of an application server in a distributed application system; the task scheduler allocates a fragmentation number of a task to an online application server; and theapplication server obtains the tasks with the corresponding numbers from the task database in a batch pulling mode according to the distribution result, and processes the obtained tasks in a stream processing mode. By applying the method and the system, the batch task scheduling problem under a distributed application system can be solved, task conflicts and concurrent risks are avoided, and the task processing efficiency is improved by combining the characteristics of batch tasks and stream processing.
本发明公开了一种分布式系统中批任务的调度方法和系统,所述方法包括:任务调度器根据分布式应用系统中应用服务器的在线情况,确定任务的分片总数M;所述任务调度器为在线的应用服务器分配任务的分片编号;所述应用服务器根据分配结果以批量拉取的方式 |
---|