Web crawler scheduler that utilizes sitemaps from websites

Systems and methods for scheduling documents for crawling are disclosed. In some implementations, a method includes obtaining sitemap information for a plurality of websites; and analyzing the sitemap information to identify a website, in the plurality of websites. The website has sitemap informatio...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	KELLER RALPH MICHAEL, BRAWER SASCHA B, IBEL MAXIMILIAN, SHIVAKUMAR NARAYANAN
Format:	Patent
Sprache:	eng
Schlagworte:	CALCULATING COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!