Timing multi-task webpage data capturing system and method
The invention relates to data acquisition technologies in the field of computers and the Internet, in particular to a timing multi-task webpage data capturing system and method. The problems existing in a traditional data capturing technology are solved. The method comprises the steps that when the...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to data acquisition technologies in the field of computers and the Internet, in particular to a timing multi-task webpage data capturing system and method. The problems existing in a traditional data capturing technology are solved. The method comprises the steps that when the system is started up, a timer is turned on for timing, and a data capturing task is triggered when the configured execution time of webpage data capturing is up; a data capturing module obtains information of websites to be captured from a local database, starts threads of which the number is the same as that of the websites to be captured, performs data capturing tasks with regard to the corresponding websites at the same time, processes captured content and matches the processed captured content with data in the local database; the local database performs structured storage on the data content which is captured by the data capturing module, processed and matched. The timing multi-task webpage data capturing syste |
---|