Data crawling and processing device and method thereof
The present disclosure provides a data crawling and processing method for a data crawling and processing device. The data crawling and processing device comprise a crawling interface, a processing module, an identification module and a grouped data section. The data crawling and processing method co...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The present disclosure provides a data crawling and processing method for a data crawling and processing device. The data crawling and processing device comprise a crawling interface, a processing module, an identification module and a grouped data section. The data crawling and processing method comprises below steps. The data crawling and processing device connects to a data source through the crawling interface. The data source comprises an original data and a featured content. The crawling interface receives the featured content. The crawling interface produces a tag according to the featured content. The crawling interface crawls the original data from the data source, and adds the tag to the original data to produces a tagged data. The identification module determines whether the tagged data is acceptable. When the tagged data is acceptable, the processing module groups the tagged data to form a grouped data. The grouped is stored in the grouped data section. |
---|