Data extraction method and device

The invention relates to a data extraction method and device, and the method comprises the following steps: S1, obtaining a data extraction task, and the data extraction task being divided into a plurality of data extraction subtasks; S2, selecting corresponding data nodes according to the data extr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LAN HAIXIANG, ZHANG TAO, LI WEIQUN, HUANG JIPING, TAO XINWAN, PAN ZHONGRUI, YANG QIFAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a data extraction method and device, and the method comprises the following steps: S1, obtaining a data extraction task, and the data extraction task being divided into a plurality of data extraction subtasks; S2, selecting corresponding data nodes according to the data extraction sub-tasks, and making a data extraction sequence table according to all the data nodes; and S3, extracting data from a database according to the data extraction sequence table. In the method, the data nodes are constructed according to the data types and the incidence relation between the data, the data is extracted according to the data nodes, repeated searching of the data can be avoided, the relation of the data nodes comprises the inheritance relation and the parallelism relation, inother words, multiple pieces of data can be extracted in parallel in sequence, and therefore the data extraction speed can be greatly increased. 本发明涉及一种数据抽取方法和装置,其方法包括以下步骤,S1,获取数据抽取任务,并所述数据抽取任务划分多个数据抽取子任务;S2,分别根据各个所述数据抽取子任务选取