METHOD AND APPARATUS FOR FILE COMPACTION IN KEY-VALUE STORAGE SYSTEM

A method and an apparatus for file compaction in a key-value store system relate to the field of data processing technologies, and are used to reduce I/O bandwidth and memory resources that need to be occupied when a compaction operation is performed, so that in a process of performing a compaction...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG, Jun, ZHU, Liangchang, CHEN, Shimin
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A method and an apparatus for file compaction in a key-value store system relate to the field of data processing technologies, and are used to reduce I/O bandwidth and memory resources that need to be occupied when a compaction operation is performed, so that in a process of performing a compaction operation, rates of performing other operations are not affected, and user experience is improved. The provided method includes: compacting, according to a Delete Log that corresponds to a to-be-compacted SSTable, the to-be-compacted SSTable, to generate a new SSTable, where a key corresponding to a non-latest value that is in the KV-Store system and that is stored in the to-be-compacted SSTable is recorded in the Delete Log, and the new SSTable does not include a key-value pair that corresponds to the key in Delete Log (S301); and deleting the to-be-compacted SSTable (S302).