Cross-cluster data consistency verification method and device and computer equipment
The invention relates to the technical field of big data processing, in particular to a cross-cluster data consistency verification method and device, computer equipment, a storage medium and a computer program product. In response to a data verification demand, determining a source end data cluster...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the technical field of big data processing, in particular to a cross-cluster data consistency verification method and device, computer equipment, a storage medium and a computer program product. In response to a data verification demand, determining a source end data cluster and a target end data cluster participating in data comparison; sorting the data in the source end data cluster based on a preset sorting processing flow to obtain a source end data queue; sorting the data in the target end data cluster based on the sorting processing flow to obtain a target end data queue; and orderly comparing the source end data queue with the target end data queue to obtain a data consistency verification result. By adopting the method, the data comparison efficiency and the comparison result accuracy can be improved.
本申请涉及大数据处理技术领域,特别是涉及一种跨集群数据一致性校验方法、装置、计算机设备、存储介质和计算机程序产品。响应于数据校验需求,确定参与数据比对的源端数据集群以及目标端数据集群;基于预设的排序处理流程对所述源端数据集群中的数据进行排序,得到源端数据队列;基于所述排序处理流程对所述目标端数据集群中的数据进行排序,得到目标端数据队列;将所述源端数据队列 |
---|