SSD-oriented time series data storage method and system based on LSMTree
The invention relates to an SSD (Solid State Disk)-oriented time series data storage method and system based on an LSMTree. According to the method, a plurality of WALWriters are provided in a WAL module, received data are equally distributed to each WALWriter, and the data can be written into a WAL...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to an SSD (Solid State Disk)-oriented time series data storage method and system based on an LSMTree. According to the method, a plurality of WALWriters are provided in a WAL module, received data are equally distributed to each WALWriter, and the data can be written into a WAL file in parallel; when the cache is written into the disk SSTable file, the SeriesKey is sorted according to the field value number of the FieldValues, only the time sequence data of which the field value number of the FieldValues reaches the threshold value is written into the SSTable file, and the data which does not meet the condition continues to be stored in the cache, so that the storage of the SeriesKey data as large as possible in the SSTable file is facilitated, and the probability that the data is repeatedly read when smaller files are combined is reduced. According to the method, the internal parallelism of the SSD is fully utilized, the write throughput of the whole storage system is improved, the writ |
---|