Webpage information acquisition method and device and computer readable storage medium

The invention discloses a webpage information acquisition method and device and a computer readable storage medium, and the method comprises the steps: carrying out the polling of different configuredmonitoring types, and carrying out the acquisition of webpage information; Acquiring site monitoring...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: GAO XUNYANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a webpage information acquisition method and device and a computer readable storage medium, and the method comprises the steps: carrying out the polling of different configuredmonitoring types, and carrying out the acquisition of webpage information; Acquiring site monitoring information configured for the monitoring type; Performing webpage crawling according to the address information to obtain corresponding page data; Determining the type of the corresponding webpage according to the obtained page data, wherein the type of the webpage comprises a list page and a detail page; When the webpage corresponding to the page data is a list page, obtaining address information for continuously crawling the webpage according to link information carried in the page data, and carrying out trillions of crawling; And when the webpage corresponding to the page data is the detail page, carrying out keyword matching processing on the page data to obtain webpage information matched with the concerned