Multi-thread multi-dimensional data processing method, device and equipment and storage medium
The invention relates to the technical field of big data, discloses a multi-thread multi-dimensional data processing method, device and equipment and a storage medium. The method, device and equipment are used for simplifying the business complexity of large-batch data and improving the data batch p...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the technical field of big data, discloses a multi-thread multi-dimensional data processing method, device and equipment and a storage medium. The method, device and equipment are used for simplifying the business complexity of large-batch data and improving the data batch processing efficiency. The method comprises the steps of obtaining an original data set, wherein the original data set comprises multiple service data of the same batch; identifying the original data set according to a preset classification rule to obtain a plurality of two-dimensional arrays, each two-dimensional array comprising an outer-layer dimension identifier and an inner-layer dimension identifier; configuring the plurality of two-dimensional arrays to obtain a plurality of target LIST containers; respectively generating corresponding sub-threads according to the sizes of the plurality of target LIST containers to obtain a plurality of sub-threads; and processing the original data set through a preset thread |
---|