Cross-cluster data consistency verification method and device and computer equipment

The invention relates to the technical field of big data processing, in particular to a cross-cluster data consistency verification method and device, computer equipment, a storage medium and a computer program product. In response to a data verification demand, determining a source end data cluster...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XU TIANJIAO, FAN ZHENG, WANG HOUYU, WU HUICHEN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to the technical field of big data processing, in particular to a cross-cluster data consistency verification method and device, computer equipment, a storage medium and a computer program product. In response to a data verification demand, determining a source end data cluster and a target end data cluster participating in data comparison; sorting the data in the source end data cluster based on a preset sorting processing flow to obtain a source end data queue; sorting the data in the target end data cluster based on the sorting processing flow to obtain a target end data queue; and orderly comparing the source end data queue with the target end data queue to obtain a data consistency verification result. By adopting the method, the data comparison efficiency and the comparison result accuracy can be improved. 本申请涉及大数据处理技术领域,特别是涉及一种跨集群数据一致性校验方法、装置、计算机设备、存储介质和计算机程序产品。响应于数据校验需求,确定参与数据比对的源端数据集群以及目标端数据集群;基于预设的排序处理流程对所述源端数据集群中的数据进行排序,得到源端数据队列;基于所述排序处理流程对所述目标端数据集群中的数据进行排序,得到目标端数据队列;将所述源端数据队列