Data processing method, device and equipment and readable storage medium

The invention provides a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: screening target data stored in a message queue according to a preset rule to obtain screened data, the screened data being used for indicating that there is chang...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LENG YINGYING, WEN JING, SONG LIJUAN, WANG RUI, HUANG CHONG, XING YUQIANG, ZHANG KAIHENG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: screening target data stored in a message queue according to a preset rule to obtain screened data, the screened data being used for indicating that there is changed data in the target data in a fixed time window; and processing the screened data according to a configuration rule corresponding to the target data, and obtaining a data logic table, wherein attribute information of the changed data is recorded in the data logic table, and the attribute information comprises a source of the changed data. According to the method, the data processing efficiency of the data platform is obviously improved, and the data processing cost is reduced. 本申请提供一种数据处理的方法、装置、设备和可读存储介质,该方法根据预设规则,对存储在消息队列中的目标数据进行筛选,得到筛选数据,所述筛选数据用于指示在固定时间窗口内所述目标数据中有变动的数据;根据所述目标数据对应的配置规则对所述筛选数据进行处理,得到数据逻辑表,所述数据逻辑表记载有所述变动的数据的属性信息,所述属性信息包括所述变动的数据的来源。该方法明显的提高了数据平台的处理数据的效率,降低了数据处理的成本。