Mass heterogeneous data storage method and system
The invention discloses a massive heterogeneous data storage method and system. The method comprises the steps of obtaining massive heterogeneous data from a data source; classifying the massive heterogeneous data into structured data, semi-structured data, non-structured data and hot spot data gene...
Gespeichert in:
Hauptverfasser: | , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a massive heterogeneous data storage method and system. The method comprises the steps of obtaining massive heterogeneous data from a data source; classifying the massive heterogeneous data into structured data, semi-structured data, non-structured data and hot spot data generated in the system operation process according to set rules; according to metadata of the data, storing the data of different types in different data storage partitions, and the different data storage partitions comprising a relational database Oracle, a MySQL, a non-relational database HBase and amemory database Redis. According to the massive heterogeneous data storage method and system provided by the invention, effective combination and unified storage management of massive structured data, semi-structured data and non-structured data are realized by integrating multiple databases, and the problems of heterogeneity, massive performance and uncertainty of the data are solved.
本发明公开了一种海量异构数据存储方法及系统,所述方法包括:从数据源获取 |
---|