Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems

Communication interfaces of high performance computing (HPC) systems and clouds have been continually evolving to meet the ever increasing communication demands being placed on them by HPC applications and cloud computing middleware (e.g., Hadoop). The PCIe interfaces can now deliver speeds up to 12...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Vienne, J., Chen, J., Wasi-Ur-Rahman, M., Islam, N. S., Subramoni, H., Panda, D. K.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 55
container_issue
container_start_page 48
container_title
container_volume
creator Vienne, J.
Chen, J.
Wasi-Ur-Rahman, M.
Islam, N. S.
Subramoni, H.
Panda, D. K.
description Communication interfaces of high performance computing (HPC) systems and clouds have been continually evolving to meet the ever increasing communication demands being placed on them by HPC applications and cloud computing middleware (e.g., Hadoop). The PCIe interfaces can now deliver speeds up to 128 Gbps (Gen3) and high performance interconnects (10/40 GigE, InfiniBand 32 Gbps QDR, InfiniBand 54 Gbps FDR, 10/40 GigE RDMA over Converged Ethernet) are capable of delivering speeds from 10 to 54 Gbps. However, no previous study has demonstrated how much benefit an end user in the HPC / cloud computing domain can expect by utilizing newer generations of these interconnects over older ones or how one type of interconnect (such as IB) performs in comparison to another (such as RoCE).In this paper we evaluate various high performance interconnects over the new PCIe Gen3 interface with HPC as well as cloud computing workloads. Our comprehensive analysis done at different levels, provides a global scope of the impact these modern interconnects have on the performance of HPC applications and cloud computing middleware. The results of our experiments show that the latest InfiniBand FDR interconnect gives the best performance for HPC as well as cloud computing applications.
doi_str_mv 10.1109/HOTI.2012.19
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_6299072</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6299072</ieee_id><sourcerecordid>6299072</sourcerecordid><originalsourceid>FETCH-LOGICAL-c133t-de7d3f611c0ad720a677c4211c6dc3c79bf2a74aa60fdd6985fd0bb073f1b9713</originalsourceid><addsrcrecordid>eNotjMtOwzAURM1LopTu2LHxD6T47XhZQvqQKrUqZV05sV2MEqeKE6T-PaEwi7mauUcDwBNGU4yRellu9qspQZhMsboCD0gKxVlKcXoNRoRSknAu1A2YKJliJiQlKRXsFoww5yhhUrF7MInxCw0aCMzTEfjc2tY1ba1DaeEs6OocfYQ6GJh_66rXnW8CbBxcBeeDf_19zN92F4ChhT_mcNdkORyg5Ta71FnV9IM39anvfDjC93PsbB0fwZ3TVbST_zsGH_N8ny2T9WaxymbrpMSUdomx0lAnMC6RNpIgLaQsGRmyMCUtpSoc0ZJpLZAzRqiUO4OKAknqcKEkpmPw_LfrrbWHU-tr3Z4PgiiFJKE_mYpZ5A</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Vienne, J. ; Chen, J. ; Wasi-Ur-Rahman, M. ; Islam, N. S. ; Subramoni, H. ; Panda, D. K.</creator><creatorcontrib>Vienne, J. ; Chen, J. ; Wasi-Ur-Rahman, M. ; Islam, N. S. ; Subramoni, H. ; Panda, D. K.</creatorcontrib><description>Communication interfaces of high performance computing (HPC) systems and clouds have been continually evolving to meet the ever increasing communication demands being placed on them by HPC applications and cloud computing middleware (e.g., Hadoop). The PCIe interfaces can now deliver speeds up to 128 Gbps (Gen3) and high performance interconnects (10/40 GigE, InfiniBand 32 Gbps QDR, InfiniBand 54 Gbps FDR, 10/40 GigE RDMA over Converged Ethernet) are capable of delivering speeds from 10 to 54 Gbps. However, no previous study has demonstrated how much benefit an end user in the HPC / cloud computing domain can expect by utilizing newer generations of these interconnects over older ones or how one type of interconnect (such as IB) performs in comparison to another (such as RoCE).In this paper we evaluate various high performance interconnects over the new PCIe Gen3 interface with HPC as well as cloud computing workloads. Our comprehensive analysis done at different levels, provides a global scope of the impact these modern interconnects have on the performance of HPC applications and cloud computing middleware. The results of our experiments show that the latest InfiniBand FDR interconnect gives the best performance for HPC as well as cloud computing applications.</description><identifier>ISSN: 1550-4794</identifier><identifier>ISBN: 9781467328364</identifier><identifier>ISBN: 1467328367</identifier><identifier>EISSN: 2332-5569</identifier><identifier>EISBN: 0769548318</identifier><identifier>EISBN: 9780769548319</identifier><identifier>DOI: 10.1109/HOTI.2012.19</identifier><identifier>CODEN: IEEPAD</identifier><language>eng</language><publisher>IEEE</publisher><subject>Bandwidth ; Benchmark testing ; Cloud computing ; Encoding ; Protocols ; Sockets</subject><ispartof>2012 IEEE 20th Annual Symposium on High-Performance Interconnects, 2012, p.48-55</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c133t-de7d3f611c0ad720a677c4211c6dc3c79bf2a74aa60fdd6985fd0bb073f1b9713</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6299072$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6299072$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Vienne, J.</creatorcontrib><creatorcontrib>Chen, J.</creatorcontrib><creatorcontrib>Wasi-Ur-Rahman, M.</creatorcontrib><creatorcontrib>Islam, N. S.</creatorcontrib><creatorcontrib>Subramoni, H.</creatorcontrib><creatorcontrib>Panda, D. K.</creatorcontrib><title>Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems</title><title>2012 IEEE 20th Annual Symposium on High-Performance Interconnects</title><addtitle>HIS</addtitle><description>Communication interfaces of high performance computing (HPC) systems and clouds have been continually evolving to meet the ever increasing communication demands being placed on them by HPC applications and cloud computing middleware (e.g., Hadoop). The PCIe interfaces can now deliver speeds up to 128 Gbps (Gen3) and high performance interconnects (10/40 GigE, InfiniBand 32 Gbps QDR, InfiniBand 54 Gbps FDR, 10/40 GigE RDMA over Converged Ethernet) are capable of delivering speeds from 10 to 54 Gbps. However, no previous study has demonstrated how much benefit an end user in the HPC / cloud computing domain can expect by utilizing newer generations of these interconnects over older ones or how one type of interconnect (such as IB) performs in comparison to another (such as RoCE).In this paper we evaluate various high performance interconnects over the new PCIe Gen3 interface with HPC as well as cloud computing workloads. Our comprehensive analysis done at different levels, provides a global scope of the impact these modern interconnects have on the performance of HPC applications and cloud computing middleware. The results of our experiments show that the latest InfiniBand FDR interconnect gives the best performance for HPC as well as cloud computing applications.</description><subject>Bandwidth</subject><subject>Benchmark testing</subject><subject>Cloud computing</subject><subject>Encoding</subject><subject>Protocols</subject><subject>Sockets</subject><issn>1550-4794</issn><issn>2332-5569</issn><isbn>9781467328364</isbn><isbn>1467328367</isbn><isbn>0769548318</isbn><isbn>9780769548319</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2012</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotjMtOwzAURM1LopTu2LHxD6T47XhZQvqQKrUqZV05sV2MEqeKE6T-PaEwi7mauUcDwBNGU4yRellu9qspQZhMsboCD0gKxVlKcXoNRoRSknAu1A2YKJliJiQlKRXsFoww5yhhUrF7MInxCw0aCMzTEfjc2tY1ba1DaeEs6OocfYQ6GJh_66rXnW8CbBxcBeeDf_19zN92F4ChhT_mcNdkORyg5Ta71FnV9IM39anvfDjC93PsbB0fwZ3TVbST_zsGH_N8ny2T9WaxymbrpMSUdomx0lAnMC6RNpIgLaQsGRmyMCUtpSoc0ZJpLZAzRqiUO4OKAknqcKEkpmPw_LfrrbWHU-tr3Z4PgiiFJKE_mYpZ5A</recordid><startdate>201208</startdate><enddate>201208</enddate><creator>Vienne, J.</creator><creator>Chen, J.</creator><creator>Wasi-Ur-Rahman, M.</creator><creator>Islam, N. S.</creator><creator>Subramoni, H.</creator><creator>Panda, D. K.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>201208</creationdate><title>Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems</title><author>Vienne, J. ; Chen, J. ; Wasi-Ur-Rahman, M. ; Islam, N. S. ; Subramoni, H. ; Panda, D. K.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c133t-de7d3f611c0ad720a677c4211c6dc3c79bf2a74aa60fdd6985fd0bb073f1b9713</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Bandwidth</topic><topic>Benchmark testing</topic><topic>Cloud computing</topic><topic>Encoding</topic><topic>Protocols</topic><topic>Sockets</topic><toplevel>online_resources</toplevel><creatorcontrib>Vienne, J.</creatorcontrib><creatorcontrib>Chen, J.</creatorcontrib><creatorcontrib>Wasi-Ur-Rahman, M.</creatorcontrib><creatorcontrib>Islam, N. S.</creatorcontrib><creatorcontrib>Subramoni, H.</creatorcontrib><creatorcontrib>Panda, D. K.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Vienne, J.</au><au>Chen, J.</au><au>Wasi-Ur-Rahman, M.</au><au>Islam, N. S.</au><au>Subramoni, H.</au><au>Panda, D. K.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems</atitle><btitle>2012 IEEE 20th Annual Symposium on High-Performance Interconnects</btitle><stitle>HIS</stitle><date>2012-08</date><risdate>2012</risdate><spage>48</spage><epage>55</epage><pages>48-55</pages><issn>1550-4794</issn><eissn>2332-5569</eissn><isbn>9781467328364</isbn><isbn>1467328367</isbn><eisbn>0769548318</eisbn><eisbn>9780769548319</eisbn><coden>IEEPAD</coden><abstract>Communication interfaces of high performance computing (HPC) systems and clouds have been continually evolving to meet the ever increasing communication demands being placed on them by HPC applications and cloud computing middleware (e.g., Hadoop). The PCIe interfaces can now deliver speeds up to 128 Gbps (Gen3) and high performance interconnects (10/40 GigE, InfiniBand 32 Gbps QDR, InfiniBand 54 Gbps FDR, 10/40 GigE RDMA over Converged Ethernet) are capable of delivering speeds from 10 to 54 Gbps. However, no previous study has demonstrated how much benefit an end user in the HPC / cloud computing domain can expect by utilizing newer generations of these interconnects over older ones or how one type of interconnect (such as IB) performs in comparison to another (such as RoCE).In this paper we evaluate various high performance interconnects over the new PCIe Gen3 interface with HPC as well as cloud computing workloads. Our comprehensive analysis done at different levels, provides a global scope of the impact these modern interconnects have on the performance of HPC applications and cloud computing middleware. The results of our experiments show that the latest InfiniBand FDR interconnect gives the best performance for HPC as well as cloud computing applications.</abstract><pub>IEEE</pub><doi>10.1109/HOTI.2012.19</doi><tpages>8</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1550-4794
ispartof 2012 IEEE 20th Annual Symposium on High-Performance Interconnects, 2012, p.48-55
issn 1550-4794
2332-5569
language eng
recordid cdi_ieee_primary_6299072
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Bandwidth
Benchmark testing
Cloud computing
Encoding
Protocols
Sockets
title Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-23T12%3A26%3A48IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Performance%20Analysis%20and%20Evaluation%20of%20InfiniBand%20FDR%20and%2040GigE%20RoCE%20on%20HPC%20and%20Cloud%20Computing%20Systems&rft.btitle=2012%20IEEE%2020th%20Annual%20Symposium%20on%20High-Performance%20Interconnects&rft.au=Vienne,%20J.&rft.date=2012-08&rft.spage=48&rft.epage=55&rft.pages=48-55&rft.issn=1550-4794&rft.eissn=2332-5569&rft.isbn=9781467328364&rft.isbn_list=1467328367&rft.coden=IEEPAD&rft_id=info:doi/10.1109/HOTI.2012.19&rft_dat=%3Cieee_6IE%3E6299072%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=0769548318&rft.eisbn_list=9780769548319&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=6299072&rfr_iscdi=true