Data extraction method and device, computer equipment and storage medium

The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for stor...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: FENG YUNQING
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi