Hint Controlled Distribution with Parallel File Systems

The performance of scientific parallel programs with high file-I/O-activity running on top of cluster computers strongly depends on the qualitative and quantitative characteristics of the requested I/O-accesses. It also depends on the corresponding mechanisms and policies being used at the parallel...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Lucas, Hipolito Vasquez, Ludwig, Thomas
Format:	Tagungsbericht
Sprache:	eng
Schlagworte:	Access Pattern Applied sciences Computer science control theory systems Computer systems and distributed systems. User interface Exact sciences and technology Metadata Server Parallel File System Request Size Software Strip Size
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

container_end_page	118
container_issue
container_start_page	110
container_title
container_volume
creator	Lucas, Hipolito Vasquez Ludwig, Thomas
description	The performance of scientific parallel programs with high file-I/O-activity running on top of cluster computers strongly depends on the qualitative and quantitative characteristics of the requested I/O-accesses. It also depends on the corresponding mechanisms and policies being used at the parallel file system level. This paper presents the motivation and design of a set of MPI-IO-hints. These hints are used to select the distribution function with which a parallel file system manipulates an opened file. The implementation of a new physical distribution function called varstrip_dist is also presented in this article. This function is proposed based upon spatial characteristics presented by I/O-access patterns observed at the application level.
doi_str_mv	10.1007/11557265_18
format	Conference Proceeding
fullrecord	<record><control><sourceid>pascalfrancis_sprin</sourceid><recordid>TN_cdi_pascalfrancis_primary_17182451</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>17182451</sourcerecordid><originalsourceid>FETCH-LOGICAL-p219t-1e45b78c7eb12ffac7c80b9572e6de0a7951ddfdb1be4d464247636d38133cc13</originalsourceid><addsrcrecordid>eNpNkLtOAzEURM1LIoRU_MA2FBQLvrbXjxIFQpAigQTUll8Lhs1uZBuh_D0bhYLbTHFmRrqD0AXga8BY3AA0jSC80SAP0BltGKagGKWHaAIcoKaUqSM0U0LuGFEYK3aMJphiUivB6Cma5fyJxxtzgssJEsvYl2o-9CUNXRd8dRdzSdF-lzj01U8sH9WzSWZEXbWIXahetrmEdT5HJ63pcpj96RS9Le5f58t69fTwOL9d1RsCqtQQWGOFdCJYIG1rnHASWzU-EbgP2AjVgPett2AD84wzwgSn3FMJlDoHdIou970bk53p2mR6F7PepLg2aatBgCSs2fmu9r48ov49JG2H4StrwHq3nP63HP0FAXNaSg</addsrcrecordid><sourcetype>Index Database</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Hint Controlled Distribution with Parallel File Systems</title><source>Springer Books</source><creator>Lucas, Hipolito Vasquez ; Ludwig, Thomas</creator><contributor>Dongarra, Jack ; Kranzlmüller, Dieter ; Di Martino, Beniamino</contributor><creatorcontrib>Lucas, Hipolito Vasquez ; Ludwig, Thomas ; Dongarra, Jack ; Kranzlmüller, Dieter ; Di Martino, Beniamino</creatorcontrib><description>The performance of scientific parallel programs with high file-I/O-activity running on top of cluster computers strongly depends on the qualitative and quantitative characteristics of the requested I/O-accesses. It also depends on the corresponding mechanisms and policies being used at the parallel file system level. This paper presents the motivation and design of a set of MPI-IO-hints. These hints are used to select the distribution function with which a parallel file system manipulates an opened file. The implementation of a new physical distribution function called varstrip_dist is also presented in this article. This function is proposed based upon spatial characteristics presented by I/O-access patterns observed at the application level.</description><identifier>ISSN: 0302-9743</identifier><identifier>ISBN: 9783540290094</identifier><identifier>ISBN: 3540290095</identifier><identifier>EISSN: 1611-3349</identifier><identifier>EISBN: 3540319433</identifier><identifier>EISBN: 9783540319436</identifier><identifier>DOI: 10.1007/11557265_18</identifier><language>eng</language><publisher>Berlin, Heidelberg: Springer Berlin Heidelberg</publisher><subject>Access Pattern ; Applied sciences ; Computer science; control theory; systems ; Computer systems and distributed systems. User interface ; Exact sciences and technology ; Metadata Server ; Parallel File System ; Request Size ; Software ; Strip Size</subject><ispartof>Lecture notes in computer science, 2005, p.110-118</ispartof><rights>Springer-Verlag Berlin Heidelberg 2005</rights><rights>2005 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/11557265_18$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/11557265_18$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>309,310,775,776,780,785,786,789,4036,4037,27904,38234,41421,42490</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=17182451$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><contributor>Dongarra, Jack</contributor><contributor>Kranzlmüller, Dieter</contributor><contributor>Di Martino, Beniamino</contributor><creatorcontrib>Lucas, Hipolito Vasquez</creatorcontrib><creatorcontrib>Ludwig, Thomas</creatorcontrib><title>Hint Controlled Distribution with Parallel File Systems</title><title>Lecture notes in computer science</title><description>The performance of scientific parallel programs with high file-I/O-activity running on top of cluster computers strongly depends on the qualitative and quantitative characteristics of the requested I/O-accesses. It also depends on the corresponding mechanisms and policies being used at the parallel file system level. This paper presents the motivation and design of a set of MPI-IO-hints. These hints are used to select the distribution function with which a parallel file system manipulates an opened file. The implementation of a new physical distribution function called varstrip_dist is also presented in this article. This function is proposed based upon spatial characteristics presented by I/O-access patterns observed at the application level.</description><subject>Access Pattern</subject><subject>Applied sciences</subject><subject>Computer science; control theory; systems</subject><subject>Computer systems and distributed systems. User interface</subject><subject>Exact sciences and technology</subject><subject>Metadata Server</subject><subject>Parallel File System</subject><subject>Request Size</subject><subject>Software</subject><subject>Strip Size</subject><issn>0302-9743</issn><issn>1611-3349</issn><isbn>9783540290094</isbn><isbn>3540290095</isbn><isbn>3540319433</isbn><isbn>9783540319436</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2005</creationdate><recordtype>conference_proceeding</recordtype><recordid>eNpNkLtOAzEURM1LIoRU_MA2FBQLvrbXjxIFQpAigQTUll8Lhs1uZBuh_D0bhYLbTHFmRrqD0AXga8BY3AA0jSC80SAP0BltGKagGKWHaAIcoKaUqSM0U0LuGFEYK3aMJphiUivB6Cma5fyJxxtzgssJEsvYl2o-9CUNXRd8dRdzSdF-lzj01U8sH9WzSWZEXbWIXahetrmEdT5HJ63pcpj96RS9Le5f58t69fTwOL9d1RsCqtQQWGOFdCJYIG1rnHASWzU-EbgP2AjVgPett2AD84wzwgSn3FMJlDoHdIou970bk53p2mR6F7PepLg2aatBgCSs2fmu9r48ov49JG2H4StrwHq3nP63HP0FAXNaSg</recordid><startdate>2005</startdate><enddate>2005</enddate><creator>Lucas, Hipolito Vasquez</creator><creator>Ludwig, Thomas</creator><general>Springer Berlin Heidelberg</general><general>Springer</general><scope>IQODW</scope></search><sort><creationdate>2005</creationdate><title>Hint Controlled Distribution with Parallel File Systems</title><author>Lucas, Hipolito Vasquez ; Ludwig, Thomas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p219t-1e45b78c7eb12ffac7c80b9572e6de0a7951ddfdb1be4d464247636d38133cc13</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2005</creationdate><topic>Access Pattern</topic><topic>Applied sciences</topic><topic>Computer science; control theory; systems</topic><topic>Computer systems and distributed systems. User interface</topic><topic>Exact sciences and technology</topic><topic>Metadata Server</topic><topic>Parallel File System</topic><topic>Request Size</topic><topic>Software</topic><topic>Strip Size</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lucas, Hipolito Vasquez</creatorcontrib><creatorcontrib>Ludwig, Thomas</creatorcontrib><collection>Pascal-Francis</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lucas, Hipolito Vasquez</au><au>Ludwig, Thomas</au><au>Dongarra, Jack</au><au>Kranzlmüller, Dieter</au><au>Di Martino, Beniamino</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Hint Controlled Distribution with Parallel File Systems</atitle><btitle>Lecture notes in computer science</btitle><date>2005</date><risdate>2005</risdate><spage>110</spage><epage>118</epage><pages>110-118</pages><issn>0302-9743</issn><eissn>1611-3349</eissn><isbn>9783540290094</isbn><isbn>3540290095</isbn><eisbn>3540319433</eisbn><eisbn>9783540319436</eisbn><abstract>The performance of scientific parallel programs with high file-I/O-activity running on top of cluster computers strongly depends on the qualitative and quantitative characteristics of the requested I/O-accesses. It also depends on the corresponding mechanisms and policies being used at the parallel file system level. This paper presents the motivation and design of a set of MPI-IO-hints. These hints are used to select the distribution function with which a parallel file system manipulates an opened file. The implementation of a new physical distribution function called varstrip_dist is also presented in this article. This function is proposed based upon spatial characteristics presented by I/O-access patterns observed at the application level.</abstract><cop>Berlin, Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/11557265_18</doi><tpages>9</tpages></addata></record>
fulltext	fulltext
identifier	ISSN: 0302-9743
ispartof	Lecture notes in computer science, 2005, p.110-118
issn	0302-9743 1611-3349
language	eng
recordid	cdi_pascalfrancis_primary_17182451
source	Springer Books
subjects	Access Pattern Applied sciences Computer science control theory systems Computer systems and distributed systems. User interface Exact sciences and technology Metadata Server Parallel File System Request Size Software Strip Size
title	Hint Controlled Distribution with Parallel File Systems
url	https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-27T19%3A23%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-pascalfrancis_sprin&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Hint%20Controlled%20Distribution%20with%20Parallel%20File%20Systems&rft.btitle=Lecture%20notes%20in%20computer%20science&rft.au=Lucas,%20Hipolito%20Vasquez&rft.date=2005&rft.spage=110&rft.epage=118&rft.pages=110-118&rft.issn=0302-9743&rft.eissn=1611-3349&rft.isbn=9783540290094&rft.isbn_list=3540290095&rft_id=info:doi/10.1007/11557265_18&rft_dat=%3Cpascalfrancis_sprin%3E17182451%3C/pascalfrancis_sprin%3E%3Curl%3E%3C/url%3E&rft.eisbn=3540319433&rft.eisbn_list=9783540319436&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true