Calculation task layering method, distributed scheduling method and device and electronic equipment

The invention provides a calculation task layering method, a distributed scheduling method and device, electronic equipment and a computer readable storage medium. The calculation task layering methodis used for layering the calculation tasks in a big data platform, and the calculation tasks in the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHONG JIWEI, WAN SHILONG, ZHU PENGSHENG, FENG RUOYIN, ZOU XIAOFENG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a calculation task layering method, a distributed scheduling method and device, electronic equipment and a computer readable storage medium. The calculation task layering methodis used for layering the calculation tasks in a big data platform, and the calculation tasks in the big data platform comprise: a data collection task for collecting data from a business system to obtain a data set; a data cleaning calculation task for calculating data needing to be cleaned in the data set; a detail data calculation task for calculating detail data in the data set; and an application data calculation task for calculating application data in the data set. The layering method comprises the following steps: extracting a calculation task in a big data platform task set, parsing an ER association relationship of the calculation task, and layering based on the ER association relationship. According to the layering mode of the computing tasks, analysis and layering arrangement of the total set of the co