Data extraction method and device, computer equipment and storage medium

Data extraction method and device, computer equipment and storage medium

The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for stor...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: FENG YUNQING
Format: Patent
Sprache:chi ; eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator FENG YUNQING
description The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN110727724A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN110727724A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN110727724A3</originalsourceid><addsrcrecordid>eNqNi70KAjEQBtNYiPoOa6_gnUJqOZWrrOyPJfn0AubHZCM-viI-gNUUMzNV_YGFCS_JbMTFQB4yRkscLFk8ncGKTPSpCjLhUV3yCPLVRWLmGz6HddXP1eTK94LFjzO1PB0vXb9GigNKYoMAGbpz02x0q3W722__ad6eNDRI</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Data extraction method and device, computer equipment and storage medium</title><source>esp@cenet</source><creator>FENG YUNQING</creator><creatorcontrib>FENG YUNQING</creatorcontrib><description>The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2020</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20200124&amp;DB=EPODOC&amp;CC=CN&amp;NR=110727724A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,309,781,886,25569,76552</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20200124&amp;DB=EPODOC&amp;CC=CN&amp;NR=110727724A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>FENG YUNQING</creatorcontrib><title>Data extraction method and device, computer equipment and storage medium</title><description>The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2020</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNi70KAjEQBtNYiPoOa6_gnUJqOZWrrOyPJfn0AubHZCM-viI-gNUUMzNV_YGFCS_JbMTFQB4yRkscLFk8ncGKTPSpCjLhUV3yCPLVRWLmGz6HddXP1eTK94LFjzO1PB0vXb9GigNKYoMAGbpz02x0q3W722__ad6eNDRI</recordid><startdate>20200124</startdate><enddate>20200124</enddate><creator>FENG YUNQING</creator><scope>EVB</scope></search><sort><creationdate>20200124</creationdate><title>Data extraction method and device, computer equipment and storage medium</title><author>FENG YUNQING</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN110727724A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2020</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>FENG YUNQING</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>FENG YUNQING</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Data extraction method and device, computer equipment and storage medium</title><date>2020-01-24</date><risdate>2020</risdate><abstract>The invention relates to the technical field of big data, and provides a data extraction method and device, computer equipment and a storage medium. The data extraction method comprises the steps of obtaining a primary key information table, wherein the primary key information table is used for storing primary keys of data extracted from the first database and successfully loaded to the second database; comparing the primary keys in the primary key information table with the primary keys of the source data table corresponding to the first database, and determining the primary keys which are inconsistent in comparison as first target primary keys; extracting data corresponding to the first target primary key from a first database, and cleaning and converting the extracted data to obtain target loading data; acquiring unique key configuration information of a target data table corresponding to the second database, filtering the target loading data according to the unique key configuration information, and loadi</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN110727724A
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
title Data extraction method and device, computer equipment and storage medium
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-11T15%3A36%3A25IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=FENG%20YUNQING&rft.date=2020-01-24&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN110727724A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true