Distributed storage middleware based on HBase+Redis

The invention relates to a distributed storage middleware based on HBase+Redis, an HBase cluster and Redis are used as a bottom layer framework, the distributed storage middleware comprises a storagemodule and a query module, and the storage module comprises a load balancing assembly, a data caching...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CHEN YUZHONG, GUO WENZHONG, WEI MINGYANG, GUO KUN, WANG QINZE, XU LINGLING
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a distributed storage middleware based on HBase+Redis, an HBase cluster and Redis are used as a bottom layer framework, the distributed storage middleware comprises a storagemodule and a query module, and the storage module comprises a load balancing assembly, a data caching assembly and a data synchronization assembly; wherein the load balancing assembly is used for realizing load balancing of an HBase Region and a Region Server so as to improve the read-write performance of the HBase; the data cache component realizes a calorific value cache elimination strategy calculated based on a time smoothing method so as to improve the cache hit rate; the data synchronization assembly realizes data synchronization based on HBase and Redis of a coprocessor so as to avoid generation of dirty data. The distributed storage middleware is beneficial to improving the data read-write rate. 本发明涉及一种基于HBase+Redis的分布式存储中间件,以HBase集群和Redis作为底层框架,包括存储模块和查询模块,所述存储模块包括负载均衡组件、数据缓存组件和数据同步组件;所述负载均衡组件实现HBase Regi