Method for realizing HDFS high-availability scheme

The present invention relates to a method for realizing an HDFS (Hadoop Distributed File System) high-availability scheme by using a hot standby NameNode. According to the method of the present invention, on the basis of an original HDFS configuration, one hot standby NameNode node, i.e., Standby Na...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: YU ZHUOER, LAN YUNLONG, REN ZUJIE, ZHANG JILIN
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The present invention relates to a method for realizing an HDFS (Hadoop Distributed File System) high-availability scheme by using a hot standby NameNode. According to the method of the present invention, on the basis of an original HDFS configuration, one hot standby NameNode node, i.e., Standby NameNode, is introduced; the system maintains consistency of name spaces by continuously synchronizing metadata in a memory of an Active NameNode and metadata in a memory of the Standby NameNode; when the NameNode is switched, only data in Editlog is imported, thereby shortening the time required for switching of the HDFS; and when the Active NameNode is dropped and unusable, the system can automatically and quickly switch to the Standby NameNode. The method of the present invention can provide high-availability service for the HDFS.