Data acquisition method and related equipment
The invention provides a data acquisition method and related equipment. A first-level distribution message containing attribute information and a second-level distribution identifier is pre-constructed for different to-be-acquired data tables, before the data acquisition of each to-be-acquired data...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a data acquisition method and related equipment. A first-level distribution message containing attribute information and a second-level distribution identifier is pre-constructed for different to-be-acquired data tables, before the data acquisition of each to-be-acquired data table, whether corresponding to-be-acquired data tables need to be subjected to sub-table acquisition or not is determined according to a first-level distribution message, corresponding split information stored in a message queue is called from the to-be-split data tables which need to be subjected to sub-table acquisition, a plurality of data acquisition devices are controlled to perform segmented data acquisition on the to-be-split data tables according to the corresponding split information, and the plurality of acquired data sub-files are combined into one target data file, so that segmented parallel detection on the to-be-acquired data table with a large data volume is realized, the data acquisition efficiency |
---|