Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster

The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environ...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bührer, Felix, Fischer, Frank, Fleig, Georg, Gamel, Anton, Giffels, Manuel, Hauth, Thomas, Janczyk, Michael, Meier, Konrad, Quast, Günter, Roland, Benoît, Schnoor, Ulrike, Schumacher, Markus, von Suchodoletz, Dirk, Wiebelt, Bernd
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Bührer, Felix
Fischer, Frank
Fleig, Georg
Gamel, Anton
Giffels, Manuel
Hauth, Thomas
Janczyk, Michael
Meier, Konrad
Quast, Günter
Roland, Benoît
Schnoor, Ulrike
Schumacher, Markus
von Suchodoletz, Dirk
Wiebelt, Bernd
description The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications.
doi_str_mv 10.48550/arxiv.1812.11044
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1812_11044</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1812_11044</sourcerecordid><originalsourceid>FETCH-LOGICAL-a674-352600af511ba1b30d844fd4649aa58941d11f362986a7eeb323577c246789cf3</originalsourceid><addsrcrecordid>eNotz71ugzAYhWEvHaq0F9Cp3w1AMf7BjBVJm0qRyhB1RR_GJpbARoZEpVdfJe10hlc60kPIE81SroTIXjB-u0tKFc1TSjPO70m_XT2OTsOXi8sZB_djOtiaaQjraPwCwUKNcXF6MFCf1tnpGXb-4mLw1z5D8ICwd_0JahNtiCN6baAK43RenO-hGs7zYuIDubM4zObxfzfk-LY7Vvvk8Pn-Ub0eEpQFT5jIZZahFZS2SFuWdYpz23HJS0ShSk47Si2TeakkFsa0LGeiKHTOZaFKbdmGPP_d3qTNFN2IcW2u4uYmZr-i6VGj</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster</title><source>arXiv.org</source><creator>Bührer, Felix ; Fischer, Frank ; Fleig, Georg ; Gamel, Anton ; Giffels, Manuel ; Hauth, Thomas ; Janczyk, Michael ; Meier, Konrad ; Quast, Günter ; Roland, Benoît ; Schnoor, Ulrike ; Schumacher, Markus ; von Suchodoletz, Dirk ; Wiebelt, Bernd</creator><creatorcontrib>Bührer, Felix ; Fischer, Frank ; Fleig, Georg ; Gamel, Anton ; Giffels, Manuel ; Hauth, Thomas ; Janczyk, Michael ; Meier, Konrad ; Quast, Günter ; Roland, Benoît ; Schnoor, Ulrike ; Schumacher, Markus ; von Suchodoletz, Dirk ; Wiebelt, Bernd</creatorcontrib><description>The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications.</description><identifier>DOI: 10.48550/arxiv.1812.11044</identifier><language>eng</language><subject>Physics - Computational Physics ; Physics - High Energy Physics - Experiment</subject><creationdate>2018-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1812.11044$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1812.11044$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Bührer, Felix</creatorcontrib><creatorcontrib>Fischer, Frank</creatorcontrib><creatorcontrib>Fleig, Georg</creatorcontrib><creatorcontrib>Gamel, Anton</creatorcontrib><creatorcontrib>Giffels, Manuel</creatorcontrib><creatorcontrib>Hauth, Thomas</creatorcontrib><creatorcontrib>Janczyk, Michael</creatorcontrib><creatorcontrib>Meier, Konrad</creatorcontrib><creatorcontrib>Quast, Günter</creatorcontrib><creatorcontrib>Roland, Benoît</creatorcontrib><creatorcontrib>Schnoor, Ulrike</creatorcontrib><creatorcontrib>Schumacher, Markus</creatorcontrib><creatorcontrib>von Suchodoletz, Dirk</creatorcontrib><creatorcontrib>Wiebelt, Bernd</creatorcontrib><title>Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster</title><description>The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications.</description><subject>Physics - Computational Physics</subject><subject>Physics - High Energy Physics - Experiment</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz71ugzAYhWEvHaq0F9Cp3w1AMf7BjBVJm0qRyhB1RR_GJpbARoZEpVdfJe10hlc60kPIE81SroTIXjB-u0tKFc1TSjPO70m_XT2OTsOXi8sZB_djOtiaaQjraPwCwUKNcXF6MFCf1tnpGXb-4mLw1z5D8ICwd_0JahNtiCN6baAK43RenO-hGs7zYuIDubM4zObxfzfk-LY7Vvvk8Pn-Ub0eEpQFT5jIZZahFZS2SFuWdYpz23HJS0ShSk47Si2TeakkFsa0LGeiKHTOZaFKbdmGPP_d3qTNFN2IcW2u4uYmZr-i6VGj</recordid><startdate>20181220</startdate><enddate>20181220</enddate><creator>Bührer, Felix</creator><creator>Fischer, Frank</creator><creator>Fleig, Georg</creator><creator>Gamel, Anton</creator><creator>Giffels, Manuel</creator><creator>Hauth, Thomas</creator><creator>Janczyk, Michael</creator><creator>Meier, Konrad</creator><creator>Quast, Günter</creator><creator>Roland, Benoît</creator><creator>Schnoor, Ulrike</creator><creator>Schumacher, Markus</creator><creator>von Suchodoletz, Dirk</creator><creator>Wiebelt, Bernd</creator><scope>GOX</scope></search><sort><creationdate>20181220</creationdate><title>Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster</title><author>Bührer, Felix ; Fischer, Frank ; Fleig, Georg ; Gamel, Anton ; Giffels, Manuel ; Hauth, Thomas ; Janczyk, Michael ; Meier, Konrad ; Quast, Günter ; Roland, Benoît ; Schnoor, Ulrike ; Schumacher, Markus ; von Suchodoletz, Dirk ; Wiebelt, Bernd</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a674-352600af511ba1b30d844fd4649aa58941d11f362986a7eeb323577c246789cf3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Physics - Computational Physics</topic><topic>Physics - High Energy Physics - Experiment</topic><toplevel>online_resources</toplevel><creatorcontrib>Bührer, Felix</creatorcontrib><creatorcontrib>Fischer, Frank</creatorcontrib><creatorcontrib>Fleig, Georg</creatorcontrib><creatorcontrib>Gamel, Anton</creatorcontrib><creatorcontrib>Giffels, Manuel</creatorcontrib><creatorcontrib>Hauth, Thomas</creatorcontrib><creatorcontrib>Janczyk, Michael</creatorcontrib><creatorcontrib>Meier, Konrad</creatorcontrib><creatorcontrib>Quast, Günter</creatorcontrib><creatorcontrib>Roland, Benoît</creatorcontrib><creatorcontrib>Schnoor, Ulrike</creatorcontrib><creatorcontrib>Schumacher, Markus</creatorcontrib><creatorcontrib>von Suchodoletz, Dirk</creatorcontrib><creatorcontrib>Wiebelt, Bernd</creatorcontrib><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Bührer, Felix</au><au>Fischer, Frank</au><au>Fleig, Georg</au><au>Gamel, Anton</au><au>Giffels, Manuel</au><au>Hauth, Thomas</au><au>Janczyk, Michael</au><au>Meier, Konrad</au><au>Quast, Günter</au><au>Roland, Benoît</au><au>Schnoor, Ulrike</au><au>Schumacher, Markus</au><au>von Suchodoletz, Dirk</au><au>Wiebelt, Bernd</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster</atitle><date>2018-12-20</date><risdate>2018</risdate><abstract>The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications.</abstract><doi>10.48550/arxiv.1812.11044</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1812.11044
ispartof
issn
language eng
recordid cdi_arxiv_primary_1812_11044
source arXiv.org
subjects Physics - Computational Physics
Physics - High Energy Physics - Experiment
title Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-04T16%3A07%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dynamic%20Virtualized%20Deployment%20of%20Particle%20Physics%20Environments%20on%20a%20High%20Performance%20Computing%20Cluster&rft.au=B%C3%BChrer,%20Felix&rft.date=2018-12-20&rft_id=info:doi/10.48550/arxiv.1812.11044&rft_dat=%3Carxiv_GOX%3E1812_11044%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true