Method and system for performing crash protection on jobTracker hosts
An embodiment of the invention discloses a method and a system for performing crash protection on jobTracker hosts. The method comprises the following steps that each jobTracker host in a jobTracker host queue circularly receives tasks which are submitted by a user task submitting interface machine,...
Gespeichert in:
Hauptverfasser: | , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | An embodiment of the invention discloses a method and a system for performing crash protection on jobTracker hosts. The method comprises the following steps that each jobTracker host in a jobTracker host queue circularly receives tasks which are submitted by a user task submitting interface machine, wherein the tasks comprise a map task and a reduce task; a taskTracker submits task status information during task execution procedures to the corresponding jobTracker host according to the membership relationship between each jobTracker and the tasks; and every two jobTracker hosts in the jobTracker host queue backup the managed tasks and synchronize the task status information. By implementing the invention, oversized task scheduling pressure of single jobTracker host can be avoided, and single point failure of the jobTracker hosts is prevented from significantly impacting the whole system. |
---|