Timing multi-task webpage data capturing system and method

The invention relates to data acquisition technologies in the field of computers and the Internet, in particular to a timing multi-task webpage data capturing system and method. The problems existing in a traditional data capturing technology are solved. The method comprises the steps that when the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: RAN MAOQIANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to data acquisition technologies in the field of computers and the Internet, in particular to a timing multi-task webpage data capturing system and method. The problems existing in a traditional data capturing technology are solved. The method comprises the steps that when the system is started up, a timer is turned on for timing, and a data capturing task is triggered when the configured execution time of webpage data capturing is up; a data capturing module obtains information of websites to be captured from a local database, starts threads of which the number is the same as that of the websites to be captured, performs data capturing tasks with regard to the corresponding websites at the same time, processes captured content and matches the processed captured content with data in the local database; the local database performs structured storage on the data content which is captured by the data capturing module, processed and matched. The timing multi-task webpage data capturing syste