Data transmission method and device of big data platform and big data platform

The invention discloses a data transmission method and device of a big data platform and the big data platform. The method comprises the following steps: acquiring data receiving and sending records of a plurality of data nodes in the big data platform; determining data transmission path statistical...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LIU BAOQUAN, CHENG SHEWEN, CHENG CAN, HUANG SIJIAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a data transmission method and device of a big data platform and the big data platform. The method comprises the following steps: acquiring data receiving and sending records of a plurality of data nodes in the big data platform; determining data transmission path statistical information among the plurality of data nodes according to the data receiving and sending records; determining a data transmission backlog condition among the plurality of data nodes according to the data transmission path statistical information; generating a transmission instruction according to the data transmission backlog condition; the transmission instruction is used for instructing any data node to receive data reversely transmitted by any other data node in any time period or stop transmitting data to any other data node so as to relieve the data transmission backlog condition. Therefore, data transmission in the big data platform can be reasonably controlled, so that data transmission of the big data pla