Distributed scheduling method and device based on ER relationship, equipment and storage medium
The invention provides a distributed scheduling method and device based on an ER relationship, an electronic device and a computer storage medium. The distributed scheduling method based on the ER relationship is used for scheduling tasks in a big data platform, and comprises the following steps of...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a distributed scheduling method and device based on an ER relationship, an electronic device and a computer storage medium. The distributed scheduling method based on the ER relationship is used for scheduling tasks in a big data platform, and comprises the following steps of S1, determining the range of calculation tasks needing to be scheduled, and generating an initial task set; S2, performing hierarchical arrangement on tasks in all the initial task sets based on an ER relationship; S3, estimating the memory and processor overhead of each task, calculating respectivescores through a resource overhead evaluation algorithm, and performing sorting according to the scores to generate an execution task set; and S4, allocating the tasks in the execution task set to aplurality of computing nodes of the big data platform to enable the computing nodes to execute respective tasks. According to the distributed scheduling method, allocation control and overhead measurement and calculation are c |
---|