Scheduling method based on backup task running time estimation in Hadoop big data platform

The invention relates to a scheduling method based on backup task running time estimation in a Hadoop big data platform and belongs to the technical field of cloud computation platform optimization. SDN bandwidth perception capacity is adopted in the method, a BWRE backup task running time estimatio...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: SHANG FENGJUN, LI LUZHONG, YAN CHENYUN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a scheduling method based on backup task running time estimation in a Hadoop big data platform and belongs to the technical field of cloud computation platform optimization. SDN bandwidth perception capacity is adopted in the method, a BWRE backup task running time estimation model is built, and a backup task scheduling method based on a backup task prediction mechanism is optimized; credibility of a backup task is improved through comparison of remaining time for adding a slow task when the standby task is allocated to a node task requester TTi and estimated running time of the pre-started backup task on the TTi, that is, it is believed that the backup task can end earlier than an original slow task, and accordingly the effective rate of the backup task is increased. By means of the method, work turnaround time can be shortened, and system resource waste caused by invalid backup tasks can be reduced. 本发明涉及种Hadoop大数据平台中基于备份任务运行时间估计的调度方法,属于云计算平台优化技术领域。该方法采用SDN带宽感知能力,建立BWRE备份任务运行时间估计模型,