Symbolic verification of web crawler functionality and its properties

Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawli...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Shetty, K. S., Bhat, S., Singh, S.
Format:	Tagungsbericht
Sprache:	eng
Schlagworte:	Computer architecture Computers Crawlers Informatics Model Checker NuSMV Robots Search engines Symbolic Model verifier Web Crawler Web pages
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

container_end_page	6
container_issue
container_start_page	1
container_title
container_volume
creator	Shetty, K. S. Bhat, S. Singh, S.
description	Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and dynamic nature of the web, it has become a challenge to traverse through all URLs in the web documents and to handle these URLs. The entire crawling process may be viewed as traversing a web graph. The aim of this paper is to model check the crawling process and crawler properties using a symbolic model checker tool called NuSMV. The basic operation of a hypertext crawler and the crawler properties has been modeled in terms of CTL specification and it is observed that the system takes care of all the constraints by satisfying all the specifications.
doi_str_mv	10.1109/ICCCI.2012.6158649
format	Conference Proceeding
fullrecord	<record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_6158649</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6158649</ieee_id><sourcerecordid>6158649</sourcerecordid><originalsourceid>FETCH-LOGICAL-i90t-e4f153876aaf547807396cdb240175f375d7ce2cb74c58f3bb1e1f7898b3ac673</originalsourceid><addsrcrecordid>eNo1j8FKxDAURSMiqGN_QDf5gdakafKSpZTRKQy4cPZDkr5ApNOWtDr07604ns3l3MWFS8gjZwXnzDw3dV03Rcl4WSgutarMFbnnlQRYreTXJDOg_53pW5JN0ydbUUqv3JHtx3JyQxc9_cYUQ_R2jkNPh0DP6KhP9txhouGr97-97eK8UNu3NM4THdMwYpojTg_kJthuwuySG3J43R7qXb5_f2vql30eDZtzrAKXQoOyNsgKNANhlG9dWTEOMgiQLXgsvYPKSx2Ecxx5AG20E9YrEBvy9DcbEfE4pniyaTlejosf7UdM-w</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Symbolic verification of web crawler functionality and its properties</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Shetty, K. S. ; Bhat, S. ; Singh, S.</creator><creatorcontrib>Shetty, K. S. ; Bhat, S. ; Singh, S.</creatorcontrib><description>Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and dynamic nature of the web, it has become a challenge to traverse through all URLs in the web documents and to handle these URLs. The entire crawling process may be viewed as traversing a web graph. The aim of this paper is to model check the crawling process and crawler properties using a symbolic model checker tool called NuSMV. The basic operation of a hypertext crawler and the crawler properties has been modeled in terms of CTL specification and it is observed that the system takes care of all the constraints by satisfying all the specifications.</description><identifier>ISBN: 9781457715808</identifier><identifier>ISBN: 1457715805</identifier><identifier>EISBN: 1457715821</identifier><identifier>EISBN: 9781457715822</identifier><identifier>EISBN: 9781457715839</identifier><identifier>EISBN: 145771583X</identifier><identifier>DOI: 10.1109/ICCCI.2012.6158649</identifier><language>eng</language><publisher>IEEE</publisher><subject>Computer architecture ; Computers ; Crawlers ; Informatics ; Model Checker ; NuSMV ; Robots ; Search engines ; Symbolic Model verifier ; Web Crawler ; Web pages</subject><ispartof>2012 International Conference on Computer Communication and Informatics, 2012, p.1-6</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6158649$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2056,27924,54919</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6158649$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Shetty, K. S.</creatorcontrib><creatorcontrib>Bhat, S.</creatorcontrib><creatorcontrib>Singh, S.</creatorcontrib><title>Symbolic verification of web crawler functionality and its properties</title><title>2012 International Conference on Computer Communication and Informatics</title><addtitle>ICCCI</addtitle><description>Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and dynamic nature of the web, it has become a challenge to traverse through all URLs in the web documents and to handle these URLs. The entire crawling process may be viewed as traversing a web graph. The aim of this paper is to model check the crawling process and crawler properties using a symbolic model checker tool called NuSMV. The basic operation of a hypertext crawler and the crawler properties has been modeled in terms of CTL specification and it is observed that the system takes care of all the constraints by satisfying all the specifications.</description><subject>Computer architecture</subject><subject>Computers</subject><subject>Crawlers</subject><subject>Informatics</subject><subject>Model Checker</subject><subject>NuSMV</subject><subject>Robots</subject><subject>Search engines</subject><subject>Symbolic Model verifier</subject><subject>Web Crawler</subject><subject>Web pages</subject><isbn>9781457715808</isbn><isbn>1457715805</isbn><isbn>1457715821</isbn><isbn>9781457715822</isbn><isbn>9781457715839</isbn><isbn>145771583X</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2012</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNo1j8FKxDAURSMiqGN_QDf5gdakafKSpZTRKQy4cPZDkr5ApNOWtDr07604ns3l3MWFS8gjZwXnzDw3dV03Rcl4WSgutarMFbnnlQRYreTXJDOg_53pW5JN0ydbUUqv3JHtx3JyQxc9_cYUQ_R2jkNPh0DP6KhP9txhouGr97-97eK8UNu3NM4THdMwYpojTg_kJthuwuySG3J43R7qXb5_f2vql30eDZtzrAKXQoOyNsgKNANhlG9dWTEOMgiQLXgsvYPKSx2Ecxx5AG20E9YrEBvy9DcbEfE4pniyaTlejosf7UdM-w</recordid><startdate>201201</startdate><enddate>201201</enddate><creator>Shetty, K. S.</creator><creator>Bhat, S.</creator><creator>Singh, S.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>201201</creationdate><title>Symbolic verification of web crawler functionality and its properties</title><author>Shetty, K. S. ; Bhat, S. ; Singh, S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i90t-e4f153876aaf547807396cdb240175f375d7ce2cb74c58f3bb1e1f7898b3ac673</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Computer architecture</topic><topic>Computers</topic><topic>Crawlers</topic><topic>Informatics</topic><topic>Model Checker</topic><topic>NuSMV</topic><topic>Robots</topic><topic>Search engines</topic><topic>Symbolic Model verifier</topic><topic>Web Crawler</topic><topic>Web pages</topic><toplevel>online_resources</toplevel><creatorcontrib>Shetty, K. S.</creatorcontrib><creatorcontrib>Bhat, S.</creatorcontrib><creatorcontrib>Singh, S.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Shetty, K. S.</au><au>Bhat, S.</au><au>Singh, S.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Symbolic verification of web crawler functionality and its properties</atitle><btitle>2012 International Conference on Computer Communication and Informatics</btitle><stitle>ICCCI</stitle><date>2012-01</date><risdate>2012</risdate><spage>1</spage><epage>6</epage><pages>1-6</pages><isbn>9781457715808</isbn><isbn>1457715805</isbn><eisbn>1457715821</eisbn><eisbn>9781457715822</eisbn><eisbn>9781457715839</eisbn><eisbn>145771583X</eisbn><abstract>Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and dynamic nature of the web, it has become a challenge to traverse through all URLs in the web documents and to handle these URLs. The entire crawling process may be viewed as traversing a web graph. The aim of this paper is to model check the crawling process and crawler properties using a symbolic model checker tool called NuSMV. The basic operation of a hypertext crawler and the crawler properties has been modeled in terms of CTL specification and it is observed that the system takes care of all the constraints by satisfying all the specifications.</abstract><pub>IEEE</pub><doi>10.1109/ICCCI.2012.6158649</doi><tpages>6</tpages></addata></record>
fulltext	fulltext_linktorsrc
identifier	ISBN: 9781457715808
ispartof	2012 International Conference on Computer Communication and Informatics, 2012, p.1-6
issn
language	eng
recordid	cdi_ieee_primary_6158649
source	IEEE Electronic Library (IEL) Conference Proceedings
subjects	Computer architecture Computers Crawlers Informatics Model Checker NuSMV Robots Search engines Symbolic Model verifier Web Crawler Web pages
title	Symbolic verification of web crawler functionality and its properties
url	https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-11T11%3A17%3A22IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Symbolic%20verification%20of%20web%20crawler%20functionality%20and%20its%20properties&rft.btitle=2012%20International%20Conference%20on%20Computer%20Communication%20and%20Informatics&rft.au=Shetty,%20K.%20S.&rft.date=2012-01&rft.spage=1&rft.epage=6&rft.pages=1-6&rft.isbn=9781457715808&rft.isbn_list=1457715805&rft_id=info:doi/10.1109/ICCCI.2012.6158649&rft_dat=%3Cieee_6IE%3E6158649%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=1457715821&rft.eisbn_list=9781457715822&rft.eisbn_list=9781457715839&rft.eisbn_list=145771583X&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=6158649&rfr_iscdi=true