Data storage method and device based on big data technology framework

The invention discloses a data storage method based on a big data technology framework. The data storage method is characterized by comprising the following steps that a data file is collected; available data nodes are requested; the size of a single data block is obtained, the data file is partitioned according to the size of the single data block, and multiple data blocks are obtained; the number n of data block copies is obtained, the data blocks are written in the data nodes through a flow-type write-in mode, and n copies are created for each data block. Therefore, according to the data storage method and device based on the big data technology framework, network data is stored in a shunted mode, server resources are fully utilized, and the resource storage efficiency and security are improved. 本发明公开了一种基于大数据技术框架的数据存储方法，其特征在于，包括以下步骤：采集数据文件；请求可用的数据节点；获取单个数据块大小，将所述数据文件依据所述单个数据块大小分块，得到多个数据块；获取数据块副本数n，采用流式写入将所述数据块写入所述数据节点，并为每个所述数据块创建n个副本。从上面所述可以看出，本发明提供的一种基于大数据技术框架的数据存储方法及装置通过将网络数据分流存储，充分利用了服务器资源，提高资源存储效率和安全性。