Exploring dynamic load imbalance solutions with the CoMD proxy application

Proxy applications are developed to simplify studying parallel performance of scientific simulations and to test potential solutions for performance problems. However, proxy applications are typically too simple to allow work migration or to represent the load imbalance of their parent applications....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Future generation computer systems 2019-03, Vol.92 (C), p.920-932
Hauptverfasser: Pearce, Olga, Ahmed, Hadia, Larsen, Rasmus W., Pirkelbauer, Peter, Richards, David F.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 932
container_issue C
container_start_page 920
container_title Future generation computer systems
container_volume 92
creator Pearce, Olga
Ahmed, Hadia
Larsen, Rasmus W.
Pirkelbauer, Peter
Richards, David F.
description Proxy applications are developed to simplify studying parallel performance of scientific simulations and to test potential solutions for performance problems. However, proxy applications are typically too simple to allow work migration or to represent the load imbalance of their parent applications. To study the ability of load balancing solutions to balance work effectively, we enable work migration in one of the Exascale Co-design Center for Materials in Extreme Environments (ExMatEx) [[1]] applications, CoMD. We design a methodology to parameterize three key aspects necessary for studying load imbalance correction: (1) the granularity with which work can be migrated; (2) the initial load imbalance; (3) the dynamic load imbalance (how quickly the load changes over time). We present a study of the impact of flexibility in work migration in CoMD on load balance and the associated rebalancing costs for a wide range of initial and dynamic load imbalance scenarios. •A proxy application that allows us to study load imbalance and potential solutions.•Ability to control initial and dynamic load imbalance, flexibility in work migration.•An evaluation of a load balance algorithm performance on a wide range of scenarios.
doi_str_mv 10.1016/j.future.2017.12.010
format Article
fullrecord <record><control><sourceid>elsevier_osti_</sourceid><recordid>TN_cdi_osti_scitechconnect_1497267</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0167739X17300560</els_id><sourcerecordid>S0167739X17300560</sourcerecordid><originalsourceid>FETCH-LOGICAL-c379t-5e39af8f93d6e6602bb4a7c10b09551706060fb7758e8b88a9fa3dca7e32420b3</originalsourceid><addsrcrecordid>eNp9kD1PwzAQQC0EEqXwDxgs9gSfncTJgoRKy4eKWEBisxzHoa7SOLJdaP89jsKMbrjl3ZPuIXQNJAUCxe02bfdh73RKCfAUaEqAnKAZlJwmHCA_RbOI8YSz6vMcXXi_JSSSDGboZXkYOutM_4WbYy93RuHOygabXS072SuNve32wdje4x8TNjhsNF7Y1wc8OHs4YjkMnVFyBC7RWSs7r6_-9hx9rJbvi6dk_fb4vLhfJ4rxKiS5ZpVsy7ZiTaGLgtC6ziRXQGpS5TlwUsRpa87zUpd1WcqqlaxRkmtGM0pqNkc3k9f6YIRXJmi1UbbvtQoCsorTgkcomyDlrPdOt2JwZifdUQARYzSxFVM0MUYTQEWMFs_upjMdH_g22o1-HTM0xo36xpr_Bb8CTHfm</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Exploring dynamic load imbalance solutions with the CoMD proxy application</title><source>Access via ScienceDirect (Elsevier)</source><creator>Pearce, Olga ; Ahmed, Hadia ; Larsen, Rasmus W. ; Pirkelbauer, Peter ; Richards, David F.</creator><creatorcontrib>Pearce, Olga ; Ahmed, Hadia ; Larsen, Rasmus W. ; Pirkelbauer, Peter ; Richards, David F. ; Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)</creatorcontrib><description>Proxy applications are developed to simplify studying parallel performance of scientific simulations and to test potential solutions for performance problems. However, proxy applications are typically too simple to allow work migration or to represent the load imbalance of their parent applications. To study the ability of load balancing solutions to balance work effectively, we enable work migration in one of the Exascale Co-design Center for Materials in Extreme Environments (ExMatEx) [[1]] applications, CoMD. We design a methodology to parameterize three key aspects necessary for studying load imbalance correction: (1) the granularity with which work can be migrated; (2) the initial load imbalance; (3) the dynamic load imbalance (how quickly the load changes over time). We present a study of the impact of flexibility in work migration in CoMD on load balance and the associated rebalancing costs for a wide range of initial and dynamic load imbalance scenarios. •A proxy application that allows us to study load imbalance and potential solutions.•Ability to control initial and dynamic load imbalance, flexibility in work migration.•An evaluation of a load balance algorithm performance on a wide range of scenarios.</description><identifier>ISSN: 0167-739X</identifier><identifier>EISSN: 1872-7115</identifier><identifier>DOI: 10.1016/j.future.2017.12.010</identifier><language>eng</language><publisher>United States: Elsevier B.V</publisher><subject>MATHEMATICS AND COMPUTING</subject><ispartof>Future generation computer systems, 2019-03, Vol.92 (C), p.920-932</ispartof><rights>2018 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c379t-5e39af8f93d6e6602bb4a7c10b09551706060fb7758e8b88a9fa3dca7e32420b3</citedby><cites>FETCH-LOGICAL-c379t-5e39af8f93d6e6602bb4a7c10b09551706060fb7758e8b88a9fa3dca7e32420b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.future.2017.12.010$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>230,314,780,784,885,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttps://www.osti.gov/servlets/purl/1497267$$D View this record in Osti.gov$$Hfree_for_read</backlink></links><search><creatorcontrib>Pearce, Olga</creatorcontrib><creatorcontrib>Ahmed, Hadia</creatorcontrib><creatorcontrib>Larsen, Rasmus W.</creatorcontrib><creatorcontrib>Pirkelbauer, Peter</creatorcontrib><creatorcontrib>Richards, David F.</creatorcontrib><creatorcontrib>Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)</creatorcontrib><title>Exploring dynamic load imbalance solutions with the CoMD proxy application</title><title>Future generation computer systems</title><description>Proxy applications are developed to simplify studying parallel performance of scientific simulations and to test potential solutions for performance problems. However, proxy applications are typically too simple to allow work migration or to represent the load imbalance of their parent applications. To study the ability of load balancing solutions to balance work effectively, we enable work migration in one of the Exascale Co-design Center for Materials in Extreme Environments (ExMatEx) [[1]] applications, CoMD. We design a methodology to parameterize three key aspects necessary for studying load imbalance correction: (1) the granularity with which work can be migrated; (2) the initial load imbalance; (3) the dynamic load imbalance (how quickly the load changes over time). We present a study of the impact of flexibility in work migration in CoMD on load balance and the associated rebalancing costs for a wide range of initial and dynamic load imbalance scenarios. •A proxy application that allows us to study load imbalance and potential solutions.•Ability to control initial and dynamic load imbalance, flexibility in work migration.•An evaluation of a load balance algorithm performance on a wide range of scenarios.</description><subject>MATHEMATICS AND COMPUTING</subject><issn>0167-739X</issn><issn>1872-7115</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp9kD1PwzAQQC0EEqXwDxgs9gSfncTJgoRKy4eKWEBisxzHoa7SOLJdaP89jsKMbrjl3ZPuIXQNJAUCxe02bfdh73RKCfAUaEqAnKAZlJwmHCA_RbOI8YSz6vMcXXi_JSSSDGboZXkYOutM_4WbYy93RuHOygabXS072SuNve32wdje4x8TNjhsNF7Y1wc8OHs4YjkMnVFyBC7RWSs7r6_-9hx9rJbvi6dk_fb4vLhfJ4rxKiS5ZpVsy7ZiTaGLgtC6ziRXQGpS5TlwUsRpa87zUpd1WcqqlaxRkmtGM0pqNkc3k9f6YIRXJmi1UbbvtQoCsorTgkcomyDlrPdOt2JwZifdUQARYzSxFVM0MUYTQEWMFs_upjMdH_g22o1-HTM0xo36xpr_Bb8CTHfm</recordid><startdate>20190301</startdate><enddate>20190301</enddate><creator>Pearce, Olga</creator><creator>Ahmed, Hadia</creator><creator>Larsen, Rasmus W.</creator><creator>Pirkelbauer, Peter</creator><creator>Richards, David F.</creator><general>Elsevier B.V</general><general>Elsevier</general><scope>AAYXX</scope><scope>CITATION</scope><scope>OIOZB</scope><scope>OTOTI</scope></search><sort><creationdate>20190301</creationdate><title>Exploring dynamic load imbalance solutions with the CoMD proxy application</title><author>Pearce, Olga ; Ahmed, Hadia ; Larsen, Rasmus W. ; Pirkelbauer, Peter ; Richards, David F.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c379t-5e39af8f93d6e6602bb4a7c10b09551706060fb7758e8b88a9fa3dca7e32420b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>MATHEMATICS AND COMPUTING</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pearce, Olga</creatorcontrib><creatorcontrib>Ahmed, Hadia</creatorcontrib><creatorcontrib>Larsen, Rasmus W.</creatorcontrib><creatorcontrib>Pirkelbauer, Peter</creatorcontrib><creatorcontrib>Richards, David F.</creatorcontrib><creatorcontrib>Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)</creatorcontrib><collection>CrossRef</collection><collection>OSTI.GOV - Hybrid</collection><collection>OSTI.GOV</collection><jtitle>Future generation computer systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pearce, Olga</au><au>Ahmed, Hadia</au><au>Larsen, Rasmus W.</au><au>Pirkelbauer, Peter</au><au>Richards, David F.</au><aucorp>Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Exploring dynamic load imbalance solutions with the CoMD proxy application</atitle><jtitle>Future generation computer systems</jtitle><date>2019-03-01</date><risdate>2019</risdate><volume>92</volume><issue>C</issue><spage>920</spage><epage>932</epage><pages>920-932</pages><issn>0167-739X</issn><eissn>1872-7115</eissn><abstract>Proxy applications are developed to simplify studying parallel performance of scientific simulations and to test potential solutions for performance problems. However, proxy applications are typically too simple to allow work migration or to represent the load imbalance of their parent applications. To study the ability of load balancing solutions to balance work effectively, we enable work migration in one of the Exascale Co-design Center for Materials in Extreme Environments (ExMatEx) [[1]] applications, CoMD. We design a methodology to parameterize three key aspects necessary for studying load imbalance correction: (1) the granularity with which work can be migrated; (2) the initial load imbalance; (3) the dynamic load imbalance (how quickly the load changes over time). We present a study of the impact of flexibility in work migration in CoMD on load balance and the associated rebalancing costs for a wide range of initial and dynamic load imbalance scenarios. •A proxy application that allows us to study load imbalance and potential solutions.•Ability to control initial and dynamic load imbalance, flexibility in work migration.•An evaluation of a load balance algorithm performance on a wide range of scenarios.</abstract><cop>United States</cop><pub>Elsevier B.V</pub><doi>10.1016/j.future.2017.12.010</doi><tpages>13</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0167-739X
ispartof Future generation computer systems, 2019-03, Vol.92 (C), p.920-932
issn 0167-739X
1872-7115
language eng
recordid cdi_osti_scitechconnect_1497267
source Access via ScienceDirect (Elsevier)
subjects MATHEMATICS AND COMPUTING
title Exploring dynamic load imbalance solutions with the CoMD proxy application
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T21%3A26%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_osti_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Exploring%20dynamic%20load%20imbalance%20solutions%20with%20the%20CoMD%20proxy%20application&rft.jtitle=Future%20generation%20computer%20systems&rft.au=Pearce,%20Olga&rft.aucorp=Lawrence%20Livermore%20National%20Lab.%20(LLNL),%20Livermore,%20CA%20(United%20States)&rft.date=2019-03-01&rft.volume=92&rft.issue=C&rft.spage=920&rft.epage=932&rft.pages=920-932&rft.issn=0167-739X&rft.eissn=1872-7115&rft_id=info:doi/10.1016/j.future.2017.12.010&rft_dat=%3Celsevier_osti_%3ES0167739X17300560%3C/elsevier_osti_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_els_id=S0167739X17300560&rfr_iscdi=true