Data processing system and method based on big data

The invention relates to a data processing method based on big data. The method comprises the steps that S101, data features of all data are acquired to classify the data; step S102, selecting the number of data sending channels for sending the data of the type according to the actual number of the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XU LINZHOU, DAI ZHIQUAN, LIU YADAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a data processing method based on big data. The method comprises the steps that S101, data features of all data are acquired to classify the data; step S102, selecting the number of data sending channels for sending the data of the type according to the actual number of the data of the type; s103, determining the number of data sending channels for sending the data of the corresponding type according to the data type, and transmitting the data of the corresponding type; and S104, acquiring the actual transmission speed of each data sending channel, and selectively compressing the transmitted data according to the actual transmission speed of each data sending channel. According to the method and the device, the size of the data can be effectively reduced by compressing the remaining unsent data, so that the data transmission speed in unit time is increased, the data transmission efficiency is further ensured, and the data transmission speed is effectively improved. 本发明涉及一种基于大数据的数据处理方法