File compression method, device and equipment applied to massive files, and storage medium
The invention relates to the technical field of data processing of financial science and technology, and discloses a file compression method, device and equipment applied to massive files and a storage medium. The method comprises the steps: acquiring files to be compressed, creating statistical thr...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the technical field of data processing of financial science and technology, and discloses a file compression method, device and equipment applied to massive files and a storage medium. The method comprises the steps: acquiring files to be compressed, creating statistical threads, and counting the total sizes of the files through the statistical threads; establishing a splitting thread, and allocating a to-be-compressed file to each split file group by the splitting thread to obtain a to-be-split file of each split file group; splitting the to-be-split file to obtain acompressed grouped file of each compressed file group, and generating a compressed grouped file list; and compressing based on the compressed grouped file list to obtain a plurality of groups of compressed files. Threads of the corresponding number are created in the stages of statistics, grouping, splitting and compression, and compared with a traditional single-thread file compression mode thatthe capacity is still larg |
---|