Application-Specific Disk I/O Optimisation for a Search Engine

Operating systems only provide general-purpose I/O optimisation since they have to service various types of applications. However, application level I/O optimisation can achieve better performance since an application has a better knowledge of how to optimise disk I/O for the application. In this pa...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Xiangfei Jia, Trotman, A., O'Keefe, R., Zhiyi Huang
Format:	Tagungsbericht
Sprache:	eng
Schlagworte:	Application software Hard disks I/O optimisation Information retrieval Legged locomotion Linux Operating systems Prefetching Scheduling algorithm search engine Search engines Throughput
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

container_end_page	404
container_issue
container_start_page	399
container_title
container_volume
creator	Xiangfei Jia Trotman, A. O'Keefe, R. Zhiyi Huang
description	Operating systems only provide general-purpose I/O optimisation since they have to service various types of applications. However, application level I/O optimisation can achieve better performance since an application has a better knowledge of how to optimise disk I/O for the application. In this paper we provide a solution for application-specific I/O for optimising a search engine. It shows a 28% improvement when compared to the general-purpose I/O optimisation of Linux. Our result also shows a 11% improvement when the Linux I/O optimisation is bypassed.
doi_str_mv	10.1109/PDCAT.2008.61
format	Conference Proceeding
fullrecord	<record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_4711008</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4711008</ieee_id><sourcerecordid>4711008</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-ee70aa2bdbe122ad8d59d4fa853970c9c56ac6ea3ff234486b2d5195973294913</originalsourceid><addsrcrecordid>eNotkM1qwkAYRQdaoVaz7KqbeYHE-c3MtymEqK0gRNCuZTKZab9WY0iy6dvX_qzu4h4unEvIA2cZ5wwWu2VZHDLBmM1yfkMSMJaZHLRUSupbMhXSQKqlFhNy_0OBVGDNHUmG4YMxJrm1YGFKnoquO6F3I17adN8FjxE9XeLwSTeLilbdiGccfmsaLz11dB9c79_pqn3DNszJJLrTEJL_nJHX9epQvqTb6nlTFtsUudFjGoJhzom6qQMXwjW20dCo6KyWYJgHr3Pn8-BkjOJqYPNaNJqDBiMFKOByRh7_djGEcOx6PLv-66jM9Qtm5Tf1v0nW</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Application-Specific Disk I/O Optimisation for a Search Engine</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Xiangfei Jia ; Trotman, A. ; O'Keefe, R. ; Zhiyi Huang</creator><creatorcontrib>Xiangfei Jia ; Trotman, A. ; O'Keefe, R. ; Zhiyi Huang</creatorcontrib><description>Operating systems only provide general-purpose I/O optimisation since they have to service various types of applications. However, application level I/O optimisation can achieve better performance since an application has a better knowledge of how to optimise disk I/O for the application. In this paper we provide a solution for application-specific I/O for optimising a search engine. It shows a 28% improvement when compared to the general-purpose I/O optimisation of Linux. Our result also shows a 11% improvement when the Linux I/O optimisation is bypassed.</description><identifier>ISSN: 2379-5352</identifier><identifier>ISBN: 9780769534435</identifier><identifier>ISBN: 0769534430</identifier><identifier>DOI: 10.1109/PDCAT.2008.61</identifier><identifier>LCCN: 2008934987</identifier><language>eng</language><publisher>IEEE</publisher><subject>Application software ; Hard disks ; I/O optimisation ; Information retrieval ; Legged locomotion ; Linux ; Operating systems ; Prefetching ; Scheduling algorithm ; search engine ; Search engines ; Throughput</subject><ispartof>2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, 2008, p.399-404</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4711008$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>310,311,781,785,790,791,2059,27927,54922</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4711008$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Xiangfei Jia</creatorcontrib><creatorcontrib>Trotman, A.</creatorcontrib><creatorcontrib>O'Keefe, R.</creatorcontrib><creatorcontrib>Zhiyi Huang</creatorcontrib><title>Application-Specific Disk I/O Optimisation for a Search Engine</title><title>2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies</title><addtitle>PDCAT</addtitle><description>Operating systems only provide general-purpose I/O optimisation since they have to service various types of applications. However, application level I/O optimisation can achieve better performance since an application has a better knowledge of how to optimise disk I/O for the application. In this paper we provide a solution for application-specific I/O for optimising a search engine. It shows a 28% improvement when compared to the general-purpose I/O optimisation of Linux. Our result also shows a 11% improvement when the Linux I/O optimisation is bypassed.</description><subject>Application software</subject><subject>Hard disks</subject><subject>I/O optimisation</subject><subject>Information retrieval</subject><subject>Legged locomotion</subject><subject>Linux</subject><subject>Operating systems</subject><subject>Prefetching</subject><subject>Scheduling algorithm</subject><subject>search engine</subject><subject>Search engines</subject><subject>Throughput</subject><issn>2379-5352</issn><isbn>9780769534435</isbn><isbn>0769534430</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2008</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotkM1qwkAYRQdaoVaz7KqbeYHE-c3MtymEqK0gRNCuZTKZab9WY0iy6dvX_qzu4h4unEvIA2cZ5wwWu2VZHDLBmM1yfkMSMJaZHLRUSupbMhXSQKqlFhNy_0OBVGDNHUmG4YMxJrm1YGFKnoquO6F3I17adN8FjxE9XeLwSTeLilbdiGccfmsaLz11dB9c79_pqn3DNszJJLrTEJL_nJHX9epQvqTb6nlTFtsUudFjGoJhzom6qQMXwjW20dCo6KyWYJgHr3Pn8-BkjOJqYPNaNJqDBiMFKOByRh7_djGEcOx6PLv-66jM9Qtm5Tf1v0nW</recordid><startdate>200812</startdate><enddate>200812</enddate><creator>Xiangfei Jia</creator><creator>Trotman, A.</creator><creator>O'Keefe, R.</creator><creator>Zhiyi Huang</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>200812</creationdate><title>Application-Specific Disk I/O Optimisation for a Search Engine</title><author>Xiangfei Jia ; Trotman, A. ; O'Keefe, R. ; Zhiyi Huang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-ee70aa2bdbe122ad8d59d4fa853970c9c56ac6ea3ff234486b2d5195973294913</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2008</creationdate><topic>Application software</topic><topic>Hard disks</topic><topic>I/O optimisation</topic><topic>Information retrieval</topic><topic>Legged locomotion</topic><topic>Linux</topic><topic>Operating systems</topic><topic>Prefetching</topic><topic>Scheduling algorithm</topic><topic>search engine</topic><topic>Search engines</topic><topic>Throughput</topic><toplevel>online_resources</toplevel><creatorcontrib>Xiangfei Jia</creatorcontrib><creatorcontrib>Trotman, A.</creatorcontrib><creatorcontrib>O'Keefe, R.</creatorcontrib><creatorcontrib>Zhiyi Huang</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Xiangfei Jia</au><au>Trotman, A.</au><au>O'Keefe, R.</au><au>Zhiyi Huang</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Application-Specific Disk I/O Optimisation for a Search Engine</atitle><btitle>2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies</btitle><stitle>PDCAT</stitle><date>2008-12</date><risdate>2008</risdate><spage>399</spage><epage>404</epage><pages>399-404</pages><issn>2379-5352</issn><isbn>9780769534435</isbn><isbn>0769534430</isbn><abstract>Operating systems only provide general-purpose I/O optimisation since they have to service various types of applications. However, application level I/O optimisation can achieve better performance since an application has a better knowledge of how to optimise disk I/O for the application. In this paper we provide a solution for application-specific I/O for optimising a search engine. It shows a 28% improvement when compared to the general-purpose I/O optimisation of Linux. Our result also shows a 11% improvement when the Linux I/O optimisation is bypassed.</abstract><pub>IEEE</pub><doi>10.1109/PDCAT.2008.61</doi><tpages>6</tpages></addata></record>
fulltext	fulltext_linktorsrc
identifier	ISSN: 2379-5352
ispartof	2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, 2008, p.399-404
issn	2379-5352
language	eng
recordid	cdi_ieee_primary_4711008
source	IEEE Electronic Library (IEL) Conference Proceedings
subjects	Application software Hard disks I/O optimisation Information retrieval Legged locomotion Linux Operating systems Prefetching Scheduling algorithm search engine Search engines Throughput
title	Application-Specific Disk I/O Optimisation for a Search Engine
url	https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-18T04%3A50%3A29IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Application-Specific%20Disk%20I/O%20Optimisation%20for%20a%20Search%20Engine&rft.btitle=2008%20Ninth%20International%20Conference%20on%20Parallel%20and%20Distributed%20Computing,%20Applications%20and%20Technologies&rft.au=Xiangfei%20Jia&rft.date=2008-12&rft.spage=399&rft.epage=404&rft.pages=399-404&rft.issn=2379-5352&rft.isbn=9780769534435&rft.isbn_list=0769534430&rft_id=info:doi/10.1109/PDCAT.2008.61&rft_dat=%3Cieee_6IE%3E4711008%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=4711008&rfr_iscdi=true