Data dynamic range partitioning method and device, equipment and storage medium

The invention provides a data dynamic range partitioning method and device, equipment and a storage medium, and relates to the technical field of data processing.The data dynamic range partitioning method comprises the steps that a first preset value and a second preset value of a field partitioning...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: LYU HU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data dynamic range partitioning method and device, equipment and a storage medium, and relates to the technical field of data processing.The data dynamic range partitioning method comprises the steps that a first preset value and a second preset value of a field partitioning range are determined according to the range of a target field, and data corresponding to the target field are written in response to completion of writing; merging the partitions of which the data sizes are smaller than a second preset value in the fixed partitions, so that the merged partitions conform to a preset partition range; and in response to completion of writing of the data corresponding to the target field, splitting the partition of which the data size is greater than a first preset value in the fixed partition, so that the split partition conforms to a preset partition range. When the data is written into the data lake, the data is inserted into the corresponding partition according to the membership