Data extraction method and device, computer equipment and storage medium
The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for stor...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi |
---|