Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator

Job scheduling policies for HPC centers have been extensively studied during these last years, specially backfilling based policies. Almost all of these studies have been done using simulation tools. These tools evaluate the performance of scheduling policies using the workloads and the resource def...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Guim, F., Corbalan, J., Labarta, J.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 150
container_issue
container_start_page 145
container_title
container_volume
creator Guim, F.
Corbalan, J.
Labarta, J.
description Job scheduling policies for HPC centers have been extensively studied during these last years, specially backfilling based policies. Almost all of these studies have been done using simulation tools. These tools evaluate the performance of scheduling policies using the workloads and the resource definition as an input. To the best of our knowledge, all the existent simulators use the runtime (either requested or real) provided in the workload as a basis of their simulations. However, the runtime of a job, even executed with a fixed number of processors, depends on runtime issues such as the specific resource selection policy used for allocate the jobs or the resource jobs requirements. This paper is the first part of a more complex research project that analyzes the impact in the system performance of considering the resource sharing of running jobs. With this purpose we have included in our job scheduler simulator (the Alvio simulator) a performance model that estimates the penalty introduced in the application runtime when sharing the memory bandwidth. Experiments have been conducted with two resource selection policies and we present both the impact from the point of view of global performance metrics, such as average slowdown, and per job impact such as percentage of penalized runtime.
doi_str_mv 10.1109/MASCOTS.2007.40
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_4674409</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4674409</ieee_id><sourcerecordid>4674409</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-6c66dffd0e746a8df0a65cf71d056c5d8a9648de0e66fbeea611c60826098cd23</originalsourceid><addsrcrecordid>eNpVjDtPwzAURs1LopTODCz-AynXjn3tjKUqUKlVESkDU2Xsa2pImypJkfj3iNfAdIZzvo-xCwFDIaC4mo_K8WJZDiWAGSo4YIPCWKGkUsJqJQ5ZT-ZGZyClOfrncnXMekJLzIzOi1N21ravABKEznvsaV4HqtL2hXdr4tPNzvmO15E_UFvvG0-8XLvmS6ctv3b-Labqu76vq-QTtXzf_o1H1XuqeZk2-8p1dXPOTqKrWhr8ss8ebybL8V02W9xOx6NZloTRXYYeMcQYgIxCZ0MEh9pHIwJo9DpYV6CygYAQ4zORQyE8gpUIhfVB5n12-fObiGi1a9LGNR8rhUYpKPJPEYVXXQ</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Guim, F. ; Corbalan, J. ; Labarta, J.</creator><creatorcontrib>Guim, F. ; Corbalan, J. ; Labarta, J.</creatorcontrib><description>Job scheduling policies for HPC centers have been extensively studied during these last years, specially backfilling based policies. Almost all of these studies have been done using simulation tools. These tools evaluate the performance of scheduling policies using the workloads and the resource definition as an input. To the best of our knowledge, all the existent simulators use the runtime (either requested or real) provided in the workload as a basis of their simulations. However, the runtime of a job, even executed with a fixed number of processors, depends on runtime issues such as the specific resource selection policy used for allocate the jobs or the resource jobs requirements. This paper is the first part of a more complex research project that analyzes the impact in the system performance of considering the resource sharing of running jobs. With this purpose we have included in our job scheduler simulator (the Alvio simulator) a performance model that estimates the penalty introduced in the application runtime when sharing the memory bandwidth. Experiments have been conducted with two resource selection policies and we present both the impact from the point of view of global performance metrics, such as average slowdown, and per job impact such as percentage of penalized runtime.</description><identifier>ISSN: 1526-7539</identifier><identifier>ISBN: 9781424418534</identifier><identifier>ISBN: 1424418534</identifier><identifier>EISSN: 2375-0227</identifier><identifier>EISBN: 9781424418541</identifier><identifier>EISBN: 1424418542</identifier><identifier>DOI: 10.1109/MASCOTS.2007.40</identifier><language>eng</language><publisher>IEEE</publisher><subject>Bandwidth ; Computational modeling ; Large-scale systems ; Measurement ; Performance analysis ; Processor scheduling ; Production systems ; Resource management ; Runtime ; System performance</subject><ispartof>2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2007, p.145-150</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4674409$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2051,27904,54899</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4674409$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Guim, F.</creatorcontrib><creatorcontrib>Corbalan, J.</creatorcontrib><creatorcontrib>Labarta, J.</creatorcontrib><title>Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator</title><title>2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems</title><addtitle>MASCOT</addtitle><description>Job scheduling policies for HPC centers have been extensively studied during these last years, specially backfilling based policies. Almost all of these studies have been done using simulation tools. These tools evaluate the performance of scheduling policies using the workloads and the resource definition as an input. To the best of our knowledge, all the existent simulators use the runtime (either requested or real) provided in the workload as a basis of their simulations. However, the runtime of a job, even executed with a fixed number of processors, depends on runtime issues such as the specific resource selection policy used for allocate the jobs or the resource jobs requirements. This paper is the first part of a more complex research project that analyzes the impact in the system performance of considering the resource sharing of running jobs. With this purpose we have included in our job scheduler simulator (the Alvio simulator) a performance model that estimates the penalty introduced in the application runtime when sharing the memory bandwidth. Experiments have been conducted with two resource selection policies and we present both the impact from the point of view of global performance metrics, such as average slowdown, and per job impact such as percentage of penalized runtime.</description><subject>Bandwidth</subject><subject>Computational modeling</subject><subject>Large-scale systems</subject><subject>Measurement</subject><subject>Performance analysis</subject><subject>Processor scheduling</subject><subject>Production systems</subject><subject>Resource management</subject><subject>Runtime</subject><subject>System performance</subject><issn>1526-7539</issn><issn>2375-0227</issn><isbn>9781424418534</isbn><isbn>1424418534</isbn><isbn>9781424418541</isbn><isbn>1424418542</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2007</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpVjDtPwzAURs1LopTODCz-AynXjn3tjKUqUKlVESkDU2Xsa2pImypJkfj3iNfAdIZzvo-xCwFDIaC4mo_K8WJZDiWAGSo4YIPCWKGkUsJqJQ5ZT-ZGZyClOfrncnXMekJLzIzOi1N21ravABKEznvsaV4HqtL2hXdr4tPNzvmO15E_UFvvG0-8XLvmS6ctv3b-Labqu76vq-QTtXzf_o1H1XuqeZk2-8p1dXPOTqKrWhr8ss8ebybL8V02W9xOx6NZloTRXYYeMcQYgIxCZ0MEh9pHIwJo9DpYV6CygYAQ4zORQyE8gpUIhfVB5n12-fObiGi1a9LGNR8rhUYpKPJPEYVXXQ</recordid><startdate>200710</startdate><enddate>200710</enddate><creator>Guim, F.</creator><creator>Corbalan, J.</creator><creator>Labarta, J.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>200710</creationdate><title>Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator</title><author>Guim, F. ; Corbalan, J. ; Labarta, J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-6c66dffd0e746a8df0a65cf71d056c5d8a9648de0e66fbeea611c60826098cd23</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2007</creationdate><topic>Bandwidth</topic><topic>Computational modeling</topic><topic>Large-scale systems</topic><topic>Measurement</topic><topic>Performance analysis</topic><topic>Processor scheduling</topic><topic>Production systems</topic><topic>Resource management</topic><topic>Runtime</topic><topic>System performance</topic><toplevel>online_resources</toplevel><creatorcontrib>Guim, F.</creatorcontrib><creatorcontrib>Corbalan, J.</creatorcontrib><creatorcontrib>Labarta, J.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Guim, F.</au><au>Corbalan, J.</au><au>Labarta, J.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator</atitle><btitle>2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems</btitle><stitle>MASCOT</stitle><date>2007-10</date><risdate>2007</risdate><spage>145</spage><epage>150</epage><pages>145-150</pages><issn>1526-7539</issn><eissn>2375-0227</eissn><isbn>9781424418534</isbn><isbn>1424418534</isbn><eisbn>9781424418541</eisbn><eisbn>1424418542</eisbn><abstract>Job scheduling policies for HPC centers have been extensively studied during these last years, specially backfilling based policies. Almost all of these studies have been done using simulation tools. These tools evaluate the performance of scheduling policies using the workloads and the resource definition as an input. To the best of our knowledge, all the existent simulators use the runtime (either requested or real) provided in the workload as a basis of their simulations. However, the runtime of a job, even executed with a fixed number of processors, depends on runtime issues such as the specific resource selection policy used for allocate the jobs or the resource jobs requirements. This paper is the first part of a more complex research project that analyzes the impact in the system performance of considering the resource sharing of running jobs. With this purpose we have included in our job scheduler simulator (the Alvio simulator) a performance model that estimates the penalty introduced in the application runtime when sharing the memory bandwidth. Experiments have been conducted with two resource selection policies and we present both the impact from the point of view of global performance metrics, such as average slowdown, and per job impact such as percentage of penalized runtime.</abstract><pub>IEEE</pub><doi>10.1109/MASCOTS.2007.40</doi><tpages>6</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1526-7539
ispartof 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2007, p.145-150
issn 1526-7539
2375-0227
language eng
recordid cdi_ieee_primary_4674409
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Bandwidth
Computational modeling
Large-scale systems
Measurement
Performance analysis
Processor scheduling
Production systems
Resource management
Runtime
System performance
title Modeling the Impact of Resource Sharing in Backfilling Policies using the Alvio Simulator
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T22%3A08%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Modeling%20the%20Impact%20of%20Resource%20Sharing%20in%20Backfilling%20Policies%20using%20the%20Alvio%20Simulator&rft.btitle=2007%2015th%20International%20Symposium%20on%20Modeling,%20Analysis,%20and%20Simulation%20of%20Computer%20and%20Telecommunication%20Systems&rft.au=Guim,%20F.&rft.date=2007-10&rft.spage=145&rft.epage=150&rft.pages=145-150&rft.issn=1526-7539&rft.eissn=2375-0227&rft.isbn=9781424418534&rft.isbn_list=1424418534&rft_id=info:doi/10.1109/MASCOTS.2007.40&rft_dat=%3Cieee_6IE%3E4674409%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9781424418541&rft.eisbn_list=1424418542&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=4674409&rfr_iscdi=true