Improving the Efficiency of a Genre-Aware Approach to Focused Crawling Based on Link Context

Improving the Efficiency of a Genre-Aware Approach to Focused Crawling Based on Link Context

Focused crawlers attempt to crawl web pages that are relevant to a specific topic or user interest. Although these kinds of crawlers have been proven to be effective, they need to improve their efficiency. Focused crawlers usually use a Frontier of non-visited URLs to visit the web pages and gather...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mangaravite, V., Assis, G. T., Ferreira, A. A.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Computer science
Computers
Context
Crawlers
Document Genre Exploitation
Focused Crawling
Link Context
Search engines
Web pages
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Focused crawlers attempt to crawl web pages that are relevant to a specific topic or user interest. Although these kinds of crawlers have been proven to be effective, they need to improve their efficiency. Focused crawlers usually use a Frontier of non-visited URLs to visit the web pages and gather relavant ones. In this work, we define and evaluate a queueing policy of non-visited URLs, based on link context, to improve the efficiency of a genre-aware focused crawler. Our experimental evaluation shows, in some situations, an improvement around 100% in efficiency terms.
DOI:10.1109/LA-WEB.2012.24