Calculation task layering method, distributed scheduling method and device and electronic equipment
The invention provides a calculation task layering method, a distributed scheduling method and device, electronic equipment and a computer readable storage medium. The calculation task layering methodis used for layering the calculation tasks in a big data platform, and the calculation tasks in the...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a calculation task layering method, a distributed scheduling method and device, electronic equipment and a computer readable storage medium. The calculation task layering methodis used for layering the calculation tasks in a big data platform, and the calculation tasks in the big data platform comprise: a data collection task for collecting data from a business system to obtain a data set; a data cleaning calculation task for calculating data needing to be cleaned in the data set; a detail data calculation task for calculating detail data in the data set; and an application data calculation task for calculating application data in the data set. The layering method comprises the following steps: extracting a calculation task in a big data platform task set, parsing an ER association relationship of the calculation task, and layering based on the ER association relationship. According to the layering mode of the computing tasks, analysis and layering arrangement of the total set of the co |
---|