Scheduling method based on backup task running time estimation in Hadoop big data platform
The invention relates to a scheduling method based on backup task running time estimation in a Hadoop big data platform and belongs to the technical field of cloud computation platform optimization. SDN bandwidth perception capacity is adopted in the method, a BWRE backup task running time estimatio...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to a scheduling method based on backup task running time estimation in a Hadoop big data platform and belongs to the technical field of cloud computation platform optimization. SDN bandwidth perception capacity is adopted in the method, a BWRE backup task running time estimation model is built, and a backup task scheduling method based on a backup task prediction mechanism is optimized; credibility of a backup task is improved through comparison of remaining time for adding a slow task when the standby task is allocated to a node task requester TTi and estimated running time of the pre-started backup task on the TTi, that is, it is believed that the backup task can end earlier than an original slow task, and accordingly the effective rate of the backup task is increased. By means of the method, work turnaround time can be shortened, and system resource waste caused by invalid backup tasks can be reduced.
本发明涉及种Hadoop大数据平台中基于备份任务运行时间估计的调度方法,属于云计算平台优化技术领域。该方法采用SDN带宽感知能力,建立BWRE备份任务运行时间估计模型, |
---|