Data dynamic range partitioning method and device, equipment and storage medium
The invention provides a data dynamic range partitioning method and device, equipment and a storage medium, and relates to the technical field of data processing.The data dynamic range partitioning method comprises the steps that a first preset value and a second preset value of a field partitioning...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a data dynamic range partitioning method and device, equipment and a storage medium, and relates to the technical field of data processing.The data dynamic range partitioning method comprises the steps that a first preset value and a second preset value of a field partitioning range are determined according to the range of a target field, and data corresponding to the target field are written in response to completion of writing; merging the partitions of which the data sizes are smaller than a second preset value in the fixed partitions, so that the merged partitions conform to a preset partition range; and in response to completion of writing of the data corresponding to the target field, splitting the partition of which the data size is greater than a first preset value in the fixed partition, so that the split partition conforms to a preset partition range. When the data is written into the data lake, the data is inserted into the corresponding partition according to the membership |
---|