Method and device for file compaction in KV (Key-Value)-Store system

The embodiment of the invention discloses a method and a device for file compaction in a KV (Key-Value)-Store system, relates to the technical field of data processing. The method and the device are used for reducing I/O bandwidth and memory resources which need to be occupied when a compaction oper...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHU LIANGCHANG, CHEN SHIMIN, ZHANG JUN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention discloses a method and a device for file compaction in a KV (Key-Value)-Store system, relates to the technical field of data processing. The method and the device are used for reducing I/O bandwidth and memory resources which need to be occupied when a compaction operation is executed, so that rates for executing other operations are not affected in a process that the compaction operation is executed so as to improve user experience. The method provided by the embodiment of the invention comprises the following steps of: according to a Delete Log corresponding to a SSTable (Sorted String Table) to be compacted, carrying out compaction on the SSTable to be compacted, and generating a new SSTable, wherein the Delete Log records a Key which is stored in the SSTable to be compacted and corresponds to a non-latest Value in the KV-Store system, and the SSTable does not contain a Key-Value pair corresponding to the Key in the Delete Log; and deleting the SSTable to be compacted. 本发明实施