Webpage information acquisition method and device and computer readable storage medium
The invention discloses a webpage information acquisition method and device and a computer readable storage medium, and the method comprises the steps: carrying out the polling of different configuredmonitoring types, and carrying out the acquisition of webpage information; Acquiring site monitoring...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses a webpage information acquisition method and device and a computer readable storage medium, and the method comprises the steps: carrying out the polling of different configuredmonitoring types, and carrying out the acquisition of webpage information; Acquiring site monitoring information configured for the monitoring type; Performing webpage crawling according to the address information to obtain corresponding page data; Determining the type of the corresponding webpage according to the obtained page data, wherein the type of the webpage comprises a list page and a detail page; When the webpage corresponding to the page data is a list page, obtaining address information for continuously crawling the webpage according to link information carried in the page data, and carrying out trillions of crawling; And when the webpage corresponding to the page data is the detail page, carrying out keyword matching processing on the page data to obtain webpage information matched with the concerned |
---|