File compression method, device and equipment applied to massive files, and storage medium

The invention relates to the technical field of data processing of financial science and technology, and discloses a file compression method, device and equipment applied to massive files and a storage medium. The method comprises the steps: acquiring files to be compressed, creating statistical thr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHOU DONG, YANG DONGFANG, XIAO HEBING, WU XINGRONG, LAN CHONG, LI CHAOYANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to the technical field of data processing of financial science and technology, and discloses a file compression method, device and equipment applied to massive files and a storage medium. The method comprises the steps: acquiring files to be compressed, creating statistical threads, and counting the total sizes of the files through the statistical threads; establishing a splitting thread, and allocating a to-be-compressed file to each split file group by the splitting thread to obtain a to-be-split file of each split file group; splitting the to-be-split file to obtain acompressed grouped file of each compressed file group, and generating a compressed grouped file list; and compressing based on the compressed grouped file list to obtain a plurality of groups of compressed files. Threads of the corresponding number are created in the stages of statistics, grouping, splitting and compression, and compared with a traditional single-thread file compression mode thatthe capacity is still larg