Dynamic Virtual Clustering with Xen and Moab

As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Emeneker, Wesley, Jackson, Dave, Butikofer, Joshua, Stanzione, Dan
Format:	Tagungsbericht
Sprache:	eng
Schlagworte:	Applied sciences Computer science control theory systems Computer systems and distributed systems. User interface Dynamic Virtual Cluster Exact sciences and technology HPC Moab Software Xen
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

container_end_page	451
container_issue
container_start_page	440
container_title
container_volume
creator	Emeneker, Wesley Jackson, Dave Butikofer, Joshua Stanzione, Dan
description	As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array of applications, and sharing workload across clusters. The Dynamic Virtual Clustering (DVC) system integrates the Xen virtual machine with the Moab scheduler to allow for creation of virtual clusters on a per-job basis. These virtual clusters can provide a unique software environment for a particular application, or can provide a consistent software environment across multiple heterogeneous clusters. In this paper, the overhead of Xen-based DVC vs. native cluster performance is examined for workloads consisting of both serial and MPI-based parallel jobs.
doi_str_mv	10.1007/11942634_46
format	Conference Proceeding
fullrecord	<record><control><sourceid>pascalfrancis_sprin</sourceid><recordid>TN_cdi_pascalfrancis_primary_19151616</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>19151616</sourcerecordid><originalsourceid>FETCH-LOGICAL-p219t-114bc9718e5a056da5085f1512ea1239267e326b1467352ffc09b4dbd734c26a3</originalsourceid><addsrcrecordid>eNpNkEtLw0AUhccXWGtX_oFsXAhG7507j8xS6hMqblTcDTfJRKNpGjIp0n9vSxU8m7M4H4fDEeIE4QIB7CWiU9KQ8srsiImzGWkFymVGul0xQoOYEim3J47-AtD7YgQEMnVW0aGYxPgJaxHaDGEkzq9XLc_rInmt-2HJTTJtlnEIfd2-J9_18JG8hTbhtkweF5wfi4OKmxgmvz4WL7c3z9P7dPZ09zC9mqWdRDekiCovnMUsaAZtStaQ6Qo1ysAoyUljA0mTozKWtKyqAlyuyry0pAppmMbidNvbcSy4qXpuizr6rq_n3K88unWXQbPmzrZc7DaDQ-_zxeIregS_ucv_u4t-AHOsVHE</addsrcrecordid><sourcetype>Index Database</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Dynamic Virtual Clustering with Xen and Moab</title><source>Springer Books</source><creator>Emeneker, Wesley ; Jackson, Dave ; Butikofer, Joshua ; Stanzione, Dan</creator><contributor>Di Martino, Beniamino ; Min, Geyong ; Yang, Laurence T. ; Guo, Minyi ; Rünger, Gudula</contributor><creatorcontrib>Emeneker, Wesley ; Jackson, Dave ; Butikofer, Joshua ; Stanzione, Dan ; Di Martino, Beniamino ; Min, Geyong ; Yang, Laurence T. ; Guo, Minyi ; Rünger, Gudula</creatorcontrib><description>As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array of applications, and sharing workload across clusters. The Dynamic Virtual Clustering (DVC) system integrates the Xen virtual machine with the Moab scheduler to allow for creation of virtual clusters on a per-job basis. These virtual clusters can provide a unique software environment for a particular application, or can provide a consistent software environment across multiple heterogeneous clusters. In this paper, the overhead of Xen-based DVC vs. native cluster performance is examined for workloads consisting of both serial and MPI-based parallel jobs.</description><identifier>ISSN: 0302-9743</identifier><identifier>ISBN: 3540498605</identifier><identifier>ISBN: 9783540498605</identifier><identifier>EISSN: 1611-3349</identifier><identifier>EISBN: 9783540498629</identifier><identifier>EISBN: 3540498621</identifier><identifier>DOI: 10.1007/11942634_46</identifier><language>eng</language><publisher>Berlin, Heidelberg: Springer Berlin Heidelberg</publisher><subject>Applied sciences ; Computer science; control theory; systems ; Computer systems and distributed systems. User interface ; Dynamic Virtual Cluster ; Exact sciences and technology ; HPC ; Moab ; Software ; Xen</subject><ispartof>Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops, 2006, p.440-451</ispartof><rights>Springer-Verlag Berlin Heidelberg 2006</rights><rights>2007 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/11942634_46$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/11942634_46$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>309,310,775,776,780,785,786,789,4036,4037,27902,38232,41418,42487</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=19151616$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><contributor>Di Martino, Beniamino</contributor><contributor>Min, Geyong</contributor><contributor>Yang, Laurence T.</contributor><contributor>Guo, Minyi</contributor><contributor>Rünger, Gudula</contributor><creatorcontrib>Emeneker, Wesley</creatorcontrib><creatorcontrib>Jackson, Dave</creatorcontrib><creatorcontrib>Butikofer, Joshua</creatorcontrib><creatorcontrib>Stanzione, Dan</creatorcontrib><title>Dynamic Virtual Clustering with Xen and Moab</title><title>Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops</title><description>As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array of applications, and sharing workload across clusters. The Dynamic Virtual Clustering (DVC) system integrates the Xen virtual machine with the Moab scheduler to allow for creation of virtual clusters on a per-job basis. These virtual clusters can provide a unique software environment for a particular application, or can provide a consistent software environment across multiple heterogeneous clusters. In this paper, the overhead of Xen-based DVC vs. native cluster performance is examined for workloads consisting of both serial and MPI-based parallel jobs.</description><subject>Applied sciences</subject><subject>Computer science; control theory; systems</subject><subject>Computer systems and distributed systems. User interface</subject><subject>Dynamic Virtual Cluster</subject><subject>Exact sciences and technology</subject><subject>HPC</subject><subject>Moab</subject><subject>Software</subject><subject>Xen</subject><issn>0302-9743</issn><issn>1611-3349</issn><isbn>3540498605</isbn><isbn>9783540498605</isbn><isbn>9783540498629</isbn><isbn>3540498621</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2006</creationdate><recordtype>conference_proceeding</recordtype><recordid>eNpNkEtLw0AUhccXWGtX_oFsXAhG7507j8xS6hMqblTcDTfJRKNpGjIp0n9vSxU8m7M4H4fDEeIE4QIB7CWiU9KQ8srsiImzGWkFymVGul0xQoOYEim3J47-AtD7YgQEMnVW0aGYxPgJaxHaDGEkzq9XLc_rInmt-2HJTTJtlnEIfd2-J9_18JG8hTbhtkweF5wfi4OKmxgmvz4WL7c3z9P7dPZ09zC9mqWdRDekiCovnMUsaAZtStaQ6Qo1ysAoyUljA0mTozKWtKyqAlyuyry0pAppmMbidNvbcSy4qXpuizr6rq_n3K88unWXQbPmzrZc7DaDQ-_zxeIregS_ucv_u4t-AHOsVHE</recordid><startdate>2006</startdate><enddate>2006</enddate><creator>Emeneker, Wesley</creator><creator>Jackson, Dave</creator><creator>Butikofer, Joshua</creator><creator>Stanzione, Dan</creator><general>Springer Berlin Heidelberg</general><general>Springer</general><scope>IQODW</scope></search><sort><creationdate>2006</creationdate><title>Dynamic Virtual Clustering with Xen and Moab</title><author>Emeneker, Wesley ; Jackson, Dave ; Butikofer, Joshua ; Stanzione, Dan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p219t-114bc9718e5a056da5085f1512ea1239267e326b1467352ffc09b4dbd734c26a3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Applied sciences</topic><topic>Computer science; control theory; systems</topic><topic>Computer systems and distributed systems. User interface</topic><topic>Dynamic Virtual Cluster</topic><topic>Exact sciences and technology</topic><topic>HPC</topic><topic>Moab</topic><topic>Software</topic><topic>Xen</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Emeneker, Wesley</creatorcontrib><creatorcontrib>Jackson, Dave</creatorcontrib><creatorcontrib>Butikofer, Joshua</creatorcontrib><creatorcontrib>Stanzione, Dan</creatorcontrib><collection>Pascal-Francis</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Emeneker, Wesley</au><au>Jackson, Dave</au><au>Butikofer, Joshua</au><au>Stanzione, Dan</au><au>Di Martino, Beniamino</au><au>Min, Geyong</au><au>Yang, Laurence T.</au><au>Guo, Minyi</au><au>Rünger, Gudula</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Dynamic Virtual Clustering with Xen and Moab</atitle><btitle>Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops</btitle><date>2006</date><risdate>2006</risdate><spage>440</spage><epage>451</epage><pages>440-451</pages><issn>0302-9743</issn><eissn>1611-3349</eissn><isbn>3540498605</isbn><isbn>9783540498605</isbn><eisbn>9783540498629</eisbn><eisbn>3540498621</eisbn><abstract>As larger and larger commodity clusters for high performance computing proliferate at research institutions around the world, challenges in maintaining effective use of these systems also continue to increase. Among the many challenges are maintaining the appropriate software stack for a broad array of applications, and sharing workload across clusters. The Dynamic Virtual Clustering (DVC) system integrates the Xen virtual machine with the Moab scheduler to allow for creation of virtual clusters on a per-job basis. These virtual clusters can provide a unique software environment for a particular application, or can provide a consistent software environment across multiple heterogeneous clusters. In this paper, the overhead of Xen-based DVC vs. native cluster performance is examined for workloads consisting of both serial and MPI-based parallel jobs.</abstract><cop>Berlin, Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/11942634_46</doi><tpages>12</tpages></addata></record>
fulltext	fulltext
identifier	ISSN: 0302-9743
ispartof	Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops, 2006, p.440-451
issn	0302-9743 1611-3349
language	eng
recordid	cdi_pascalfrancis_primary_19151616
source	Springer Books
subjects	Applied sciences Computer science control theory systems Computer systems and distributed systems. User interface Dynamic Virtual Cluster Exact sciences and technology HPC Moab Software Xen
title	Dynamic Virtual Clustering with Xen and Moab
url	https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-28T18%3A26%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-pascalfrancis_sprin&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Dynamic%20Virtual%20Clustering%20with%20Xen%20and%20Moab&rft.btitle=Frontiers%20of%20High%20Performance%20Computing%20and%20Networking%20%E2%80%93%20ISPA%202006%20Workshops&rft.au=Emeneker,%20Wesley&rft.date=2006&rft.spage=440&rft.epage=451&rft.pages=440-451&rft.issn=0302-9743&rft.eissn=1611-3349&rft.isbn=3540498605&rft.isbn_list=9783540498605&rft_id=info:doi/10.1007/11942634_46&rft_dat=%3Cpascalfrancis_sprin%3E19151616%3C/pascalfrancis_sprin%3E%3Curl%3E%3C/url%3E&rft.eisbn=9783540498629&rft.eisbn_list=3540498621&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true