Ocean big data master-slave index system and method based on Spark cloud network

The invention relates to an ocean big data master-slave index system and method based on a Spark cloud network. The ocean big data master-slave index system and method are particularly suitable for ocean big data which have the advantages of space autocorrelation, high similarity, real-time performa...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XU HUIFANG, XU QIONGQIONG, ZHAO DANFENG, SUN LE, ZHENG XIAOLUO, HUANG DONGMEI
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to an ocean big data master-slave index system and method based on a Spark cloud network. The ocean big data master-slave index system and method are particularly suitable for ocean big data which have the advantages of space autocorrelation, high similarity, real-time performance and the like. The big data age internet of things, the cloud calculation and other technologies are applied to the field of distributed indexes, the internet of things serves as an antenna for ocean information collection, data division strategies are designed and the data are deployed and saved to all pieces of physical cloud in a distributed mode on the basis of the clustering thought, rapid and one-stop calling of the multi-source ocean data is achieved through the combination with a multi-layer master-slave index structure, and the requirements for high-performance calculation, strong real-time feedback, high-frequency inquiry and the like in various offshore pre-warning and emergency models are met. According to the system and the method, on the basis of physical cloud storage, the millisecond-grade inquiry response requirements are ensured, and therefore rapid and real-time disaster inversion and pre-warning are rapidly focused, and the digitalization and intellectualization progresses of ocean disaster prevention and reduction and the like are accelerated.