File deduplication processing method and device, equipment and storage medium
The invention provides a file deduplication processing method and device, equipment and a storage medium, and relates to the technical field of big data, the file deduplication processing method comprises the following steps: obtaining a target file, file information of the target file and a source...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a file deduplication processing method and device, equipment and a storage medium, and relates to the technical field of big data, the file deduplication processing method comprises the following steps: obtaining a target file, file information of the target file and a source address of a request message according to the request message in response to monitoring of the request message for file sending, the file information comprises the file size, the file name and the file byte number of the target file; determining a target file feature value corresponding to the target file according to the file information and the source address; determining whether the target file is a duplicate file or not according to the feature value of the target file and the feature value of a locally stored file; and if the target file is the duplicate file, not storing the target file. According to the method and the device, the file deduplication processing flow can be greatly simplified, the maintenance c |
---|