Data processing system and method based on big data
The invention relates to a data processing method based on big data. The method comprises the steps that S101, data features of all data are acquired to classify the data; step S102, selecting the number of data sending channels for sending the data of the type according to the actual number of the...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to a data processing method based on big data. The method comprises the steps that S101, data features of all data are acquired to classify the data; step S102, selecting the number of data sending channels for sending the data of the type according to the actual number of the data of the type; s103, determining the number of data sending channels for sending the data of the corresponding type according to the data type, and transmitting the data of the corresponding type; and S104, acquiring the actual transmission speed of each data sending channel, and selectively compressing the transmitted data according to the actual transmission speed of each data sending channel. According to the method and the device, the size of the data can be effectively reduced by compressing the remaining unsent data, so that the data transmission speed in unit time is increased, the data transmission efficiency is further ensured, and the data transmission speed is effectively improved.
本发明涉及一种基于大数据的数据处理方法 |
---|