A Query based Approach to Reduce the Web Crawler Traffic using HTTP Get Request and Dynamic Web Page

The functions of Web crawler download information from web for search engine. Web pages changed without any notice. Web crawler has to revisit web site to download updated and new web pages. It is estimated 40% of current web traffic is generated by web crawler. This paper proposes query based appro...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	International journal of computer applications 2011-01, Vol.14 (3), p.8-14
Hauptverfasser:	Mishra, Shekhar, Jain, Anurag, Sachan, A K
Format:	Artikel
Sprache:	eng
Schlagworte:	Downloading Dynamics Mathematical analysis Query processing Traffic engineering Traffic flow Websites World Wide Web
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!