Data acquisition method and distributed file system

An embodiment of the invention discloses a data acquisition method and a distributed file system. The method includes acquiring a file catalog of files to be accessed, and acquiring a node value of a predefined root node; acquiring block information of the root node according to a hash value of the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CUI XIAOCHUN, SHI XIAOFENG, CAI BIN, HAN XIN, GONG ZHENFEI, ZHANG WENYU, CUI XIAOFENG, XIAO GUIJU, QIU XIANGHU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:An embodiment of the invention discloses a data acquisition method and a distributed file system. The method includes acquiring a file catalog of files to be accessed, and acquiring a node value of a predefined root node; acquiring block information of the root node according to a hash value of the node value of the root node; when the node value of the root node corresponds to the files in a block, acquiring a data file according to a block list stored in the block and block list positional information; and when the node value of the root node corresponds to a file folder in the block, acquiring a node value of a next-level node from the file list stored in the block and the node value of the corresponding file in the file list according to the file catalog, acquiring block information of the next-level node according to the node value of the next-level node, and finally acquiring the data file. The single point problem of an HDFS (Hadoop distributed file system) can be solved, and capacity of the HDFS in co