A strategy for scheduling reduce task based on intermediate data locality of the MapReduce

In this paper, researching on task scheduling is a way from the perspective of resource allocation and management to improve performance of Hadoop system. In order to save the network bandwidth resources in Hadoop cluster environment and improve the performance of Hadoop system, a ReduceTask schedul...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Cluster computing 2017-12, Vol.20 (4), p.2821-2831
Hauptverfasser:	Shang, Fengjun, Chen, Xuanling, Yan, Chenyun
Format:	Artikel
Sprache:	eng
Schlagworte:	Bandwidths Big Data Clusters Computer Communication Networks Computer Science Consumption Data transfer (computers) Data transmission Information industry Operating Systems Optimization Performance enhancement Priority scheduling Processor Architectures Resource allocation Scheduling Task scheduling
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!