File deduplication processing method and device, equipment and storage medium

The invention provides a file deduplication processing method and device, equipment and a storage medium, and relates to the technical field of big data, the file deduplication processing method comprises the following steps: obtaining a target file, file information of the target file and a source...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: GAO YANXIANG, GUO YIFAN, XU KEBAO, CAO MINGYANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a file deduplication processing method and device, equipment and a storage medium, and relates to the technical field of big data, the file deduplication processing method comprises the following steps: obtaining a target file, file information of the target file and a source address of a request message according to the request message in response to monitoring of the request message for file sending, the file information comprises the file size, the file name and the file byte number of the target file; determining a target file feature value corresponding to the target file according to the file information and the source address; determining whether the target file is a duplicate file or not according to the feature value of the target file and the feature value of a locally stored file; and if the target file is the duplicate file, not storing the target file. According to the method and the device, the file deduplication processing flow can be greatly simplified, the maintenance c