Data acquisition method and related equipment

The invention provides a data acquisition method and related equipment. A first-level distribution message containing attribute information and a second-level distribution identifier is pre-constructed for different to-be-acquired data tables, before the data acquisition of each to-be-acquired data...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: HUANG XIANCHAO, DU SHIQIONG, SHUAI HONGBO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a data acquisition method and related equipment. A first-level distribution message containing attribute information and a second-level distribution identifier is pre-constructed for different to-be-acquired data tables, before the data acquisition of each to-be-acquired data table, whether corresponding to-be-acquired data tables need to be subjected to sub-table acquisition or not is determined according to a first-level distribution message, corresponding split information stored in a message queue is called from the to-be-split data tables which need to be subjected to sub-table acquisition, a plurality of data acquisition devices are controlled to perform segmented data acquisition on the to-be-split data tables according to the corresponding split information, and the plurality of acquired data sub-files are combined into one target data file, so that segmented parallel detection on the to-be-acquired data table with a large data volume is realized, the data acquisition efficiency