Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud

Cloud computing has seen tremendous growth, particularly for commercial web applications. The on-demand, pay-as-you-go model creates a flexible and cost-effective means to access compute resources. For these reasons, the scientific computing community has shown increasing interest in exploring cloud...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jackson, K R, Ramakrishnan, L, Muriki, K, Canon, S, Cholia, S, Shalf, J, Wasserman, H J, Wright, N J
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 168
container_issue
container_start_page 159
container_title
container_volume
creator Jackson, K R
Ramakrishnan, L
Muriki, K
Canon, S
Cholia, S
Shalf, J
Wasserman, H J
Wright, N J
description Cloud computing has seen tremendous growth, particularly for commercial web applications. The on-demand, pay-as-you-go model creates a flexible and cost-effective means to access compute resources. For these reasons, the scientific computing community has shown increasing interest in exploring cloud computing. However, the underlying implementation and performance of clouds are very different from those at traditional supercomputing centers. It is therefore critical to evaluate the performance of HPC applications in today's cloud environments to understand the tradeoffs inherent in migrating to the cloud. This work represents the most comprehensive evaluation to date comparing conventional HPC platforms to Amazon EC2, using real applications representative of the workload at a typical supercomputing center. Overall results indicate that EC2 is six times slower than a typical mid-range Linux cluster, and twenty times slower than a modern HPC system. The interconnect on the EC2 cloud platform severely limits performance and causes significant variability.
doi_str_mv 10.1109/CloudCom.2010.69
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_5708447</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5708447</ieee_id><sourcerecordid>5708447</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2459-ad45d12b8adcb3358d3f0f95bc8dc11b5ef708922f6b7bdb390609f7a571d93c3</originalsourceid><addsrcrecordid>eNpNTk1LAzEUjIig1r0LXvIHtuZzkxyXRa1QUFDxWPPZRvaLzVaov75BPTiX95g3M28AuMZoiTFSt0077F0zdEuCMlWpE1AoIZGoFGcUEXYKLjEjjCmGODkHRUqfKIMTIZS8AB_PfgrD1Oneelj3uj2kmOAQ4Cpud_D_Mf8Y93Pst7AexzZaPcehz9Iezrts7fR3Xt-9gS9--orWJ_hT7QqcBd0mX_zNBXi7v3ttVuX66eGxqdelJYyrUjvGHSZGamcNpVw6GlBQ3FjpLMaG-yCQVISEygjjDFWoQioIzQV2ilq6ADe_udF7vxmn2OnpsOHZxJigR2wNVyI</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Jackson, K R ; Ramakrishnan, L ; Muriki, K ; Canon, S ; Cholia, S ; Shalf, J ; Wasserman, H J ; Wright, N J</creator><creatorcontrib>Jackson, K R ; Ramakrishnan, L ; Muriki, K ; Canon, S ; Cholia, S ; Shalf, J ; Wasserman, H J ; Wright, N J</creatorcontrib><description>Cloud computing has seen tremendous growth, particularly for commercial web applications. The on-demand, pay-as-you-go model creates a flexible and cost-effective means to access compute resources. For these reasons, the scientific computing community has shown increasing interest in exploring cloud computing. However, the underlying implementation and performance of clouds are very different from those at traditional supercomputing centers. It is therefore critical to evaluate the performance of HPC applications in today's cloud environments to understand the tradeoffs inherent in migrating to the cloud. This work represents the most comprehensive evaluation to date comparing conventional HPC platforms to Amazon EC2, using real applications representative of the workload at a typical supercomputing center. Overall results indicate that EC2 is six times slower than a typical mid-range Linux cluster, and twenty times slower than a modern HPC system. The interconnect on the EC2 cloud platform severely limits performance and causes significant variability.</description><identifier>ISBN: 1424494052</identifier><identifier>ISBN: 9781424494057</identifier><identifier>EISBN: 9780769543024</identifier><identifier>EISBN: 0769543022</identifier><identifier>DOI: 10.1109/CloudCom.2010.69</identifier><language>eng</language><publisher>IEEE</publisher><subject>Bandwidth ; Benchmark testing ; Cloud computing ; Clouds ; Communities ; Computer aided manufacturing ; Distributed Computing ; HPC ; MPI ; Program processors ; Stress</subject><ispartof>2010 IEEE Second International Conference on Cloud Computing Technology and Science, 2010, p.159-168</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c2459-ad45d12b8adcb3358d3f0f95bc8dc11b5ef708922f6b7bdb390609f7a571d93c3</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5708447$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2052,27902,54895</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5708447$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Jackson, K R</creatorcontrib><creatorcontrib>Ramakrishnan, L</creatorcontrib><creatorcontrib>Muriki, K</creatorcontrib><creatorcontrib>Canon, S</creatorcontrib><creatorcontrib>Cholia, S</creatorcontrib><creatorcontrib>Shalf, J</creatorcontrib><creatorcontrib>Wasserman, H J</creatorcontrib><creatorcontrib>Wright, N J</creatorcontrib><title>Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud</title><title>2010 IEEE Second International Conference on Cloud Computing Technology and Science</title><addtitle>CLOUDCOM</addtitle><description>Cloud computing has seen tremendous growth, particularly for commercial web applications. The on-demand, pay-as-you-go model creates a flexible and cost-effective means to access compute resources. For these reasons, the scientific computing community has shown increasing interest in exploring cloud computing. However, the underlying implementation and performance of clouds are very different from those at traditional supercomputing centers. It is therefore critical to evaluate the performance of HPC applications in today's cloud environments to understand the tradeoffs inherent in migrating to the cloud. This work represents the most comprehensive evaluation to date comparing conventional HPC platforms to Amazon EC2, using real applications representative of the workload at a typical supercomputing center. Overall results indicate that EC2 is six times slower than a typical mid-range Linux cluster, and twenty times slower than a modern HPC system. The interconnect on the EC2 cloud platform severely limits performance and causes significant variability.</description><subject>Bandwidth</subject><subject>Benchmark testing</subject><subject>Cloud computing</subject><subject>Clouds</subject><subject>Communities</subject><subject>Computer aided manufacturing</subject><subject>Distributed Computing</subject><subject>HPC</subject><subject>MPI</subject><subject>Program processors</subject><subject>Stress</subject><isbn>1424494052</isbn><isbn>9781424494057</isbn><isbn>9780769543024</isbn><isbn>0769543022</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2010</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpNTk1LAzEUjIig1r0LXvIHtuZzkxyXRa1QUFDxWPPZRvaLzVaov75BPTiX95g3M28AuMZoiTFSt0077F0zdEuCMlWpE1AoIZGoFGcUEXYKLjEjjCmGODkHRUqfKIMTIZS8AB_PfgrD1Oneelj3uj2kmOAQ4Cpud_D_Mf8Y93Pst7AexzZaPcehz9Iezrts7fR3Xt-9gS9--orWJ_hT7QqcBd0mX_zNBXi7v3ttVuX66eGxqdelJYyrUjvGHSZGamcNpVw6GlBQ3FjpLMaG-yCQVISEygjjDFWoQioIzQV2ilq6ADe_udF7vxmn2OnpsOHZxJigR2wNVyI</recordid><startdate>201011</startdate><enddate>201011</enddate><creator>Jackson, K R</creator><creator>Ramakrishnan, L</creator><creator>Muriki, K</creator><creator>Canon, S</creator><creator>Cholia, S</creator><creator>Shalf, J</creator><creator>Wasserman, H J</creator><creator>Wright, N J</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>201011</creationdate><title>Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud</title><author>Jackson, K R ; Ramakrishnan, L ; Muriki, K ; Canon, S ; Cholia, S ; Shalf, J ; Wasserman, H J ; Wright, N J</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2459-ad45d12b8adcb3358d3f0f95bc8dc11b5ef708922f6b7bdb390609f7a571d93c3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2010</creationdate><topic>Bandwidth</topic><topic>Benchmark testing</topic><topic>Cloud computing</topic><topic>Clouds</topic><topic>Communities</topic><topic>Computer aided manufacturing</topic><topic>Distributed Computing</topic><topic>HPC</topic><topic>MPI</topic><topic>Program processors</topic><topic>Stress</topic><toplevel>online_resources</toplevel><creatorcontrib>Jackson, K R</creatorcontrib><creatorcontrib>Ramakrishnan, L</creatorcontrib><creatorcontrib>Muriki, K</creatorcontrib><creatorcontrib>Canon, S</creatorcontrib><creatorcontrib>Cholia, S</creatorcontrib><creatorcontrib>Shalf, J</creatorcontrib><creatorcontrib>Wasserman, H J</creatorcontrib><creatorcontrib>Wright, N J</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jackson, K R</au><au>Ramakrishnan, L</au><au>Muriki, K</au><au>Canon, S</au><au>Cholia, S</au><au>Shalf, J</au><au>Wasserman, H J</au><au>Wright, N J</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud</atitle><btitle>2010 IEEE Second International Conference on Cloud Computing Technology and Science</btitle><stitle>CLOUDCOM</stitle><date>2010-11</date><risdate>2010</risdate><spage>159</spage><epage>168</epage><pages>159-168</pages><isbn>1424494052</isbn><isbn>9781424494057</isbn><eisbn>9780769543024</eisbn><eisbn>0769543022</eisbn><abstract>Cloud computing has seen tremendous growth, particularly for commercial web applications. The on-demand, pay-as-you-go model creates a flexible and cost-effective means to access compute resources. For these reasons, the scientific computing community has shown increasing interest in exploring cloud computing. However, the underlying implementation and performance of clouds are very different from those at traditional supercomputing centers. It is therefore critical to evaluate the performance of HPC applications in today's cloud environments to understand the tradeoffs inherent in migrating to the cloud. This work represents the most comprehensive evaluation to date comparing conventional HPC platforms to Amazon EC2, using real applications representative of the workload at a typical supercomputing center. Overall results indicate that EC2 is six times slower than a typical mid-range Linux cluster, and twenty times slower than a modern HPC system. The interconnect on the EC2 cloud platform severely limits performance and causes significant variability.</abstract><pub>IEEE</pub><doi>10.1109/CloudCom.2010.69</doi><tpages>10</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISBN: 1424494052
ispartof 2010 IEEE Second International Conference on Cloud Computing Technology and Science, 2010, p.159-168
issn
language eng
recordid cdi_ieee_primary_5708447
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Bandwidth
Benchmark testing
Cloud computing
Clouds
Communities
Computer aided manufacturing
Distributed Computing
HPC
MPI
Program processors
Stress
title Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-10T14%3A31%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Performance%20Analysis%20of%20High%20Performance%20Computing%20Applications%20on%20the%20Amazon%20Web%20Services%20Cloud&rft.btitle=2010%20IEEE%20Second%20International%20Conference%20on%20Cloud%20Computing%20Technology%20and%20Science&rft.au=Jackson,%20K%20R&rft.date=2010-11&rft.spage=159&rft.epage=168&rft.pages=159-168&rft.isbn=1424494052&rft.isbn_list=9781424494057&rft_id=info:doi/10.1109/CloudCom.2010.69&rft_dat=%3Cieee_6IE%3E5708447%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9780769543024&rft.eisbn_list=0769543022&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=5708447&rfr_iscdi=true