Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links

Sockets Direct Protocol (SDP) is a byte stream protocol that utilizes the capabilities of the InfiniBand fabric to transparently achieve performance gains for existing socket-based networked applications. In this paper we discuss an implementation of Zero Copy support for synchronous send()/recv() s...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Goldenberg, D., Kagan, M., Ravid, R., Tsirkin, M.S.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 10
container_issue
container_start_page 1
container_title
container_volume
creator Goldenberg, D.
Kagan, M.
Ravid, R.
Tsirkin, M.S.
description Sockets Direct Protocol (SDP) is a byte stream protocol that utilizes the capabilities of the InfiniBand fabric to transparently achieve performance gains for existing socket-based networked applications. In this paper we discuss an implementation of Zero Copy support for synchronous send()/recv() socket calls, that uses the remote DMA capability of InfiniBand for SDP data transfers. We added this support to the open-source implementation of SDP over InfiniBand. We evaluate this implementation over a 20 Gb/s InfiniBand link. We demonstrate scalability of Zero Copy and show its benefits for systems that utilize multiple socket connections in parallel. For example, enabling Zero Copy with 8 active connections yields a bandwidth growth from 630MB/s to 1360MB/s, at the same time reducing the CPU utilization by a factor often
doi_str_mv 10.1109/CLUSTR.2005.347027
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_4154155</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4154155</ieee_id><sourcerecordid>4154155</sourcerecordid><originalsourceid>FETCH-LOGICAL-i90t-8623c27485178e6aa1b6bea42b8485148d145cc30dc86a74e224cd7366842c103</originalsourceid><addsrcrecordid>eNpVj9tKw0AQhtcTWGpfQG_2BdLueTeXNWotBBSb3nhTNpuprm2zYRMrfXtT1At_PhiY-Rj4EbqmZEwpSSdZvlwUL2NGiBxzoQnTJ2iUakN6eCqMkqdowKgyScokP_t3k-YcDaiULJFMiEs0atsP0oenXEs9QF9FtHXb2Ah1tz3gqXv3sPf1G158NhB9iHgR3AY6_AxxHeLO1g7wsj0arxADzkJz-FPufATXmzF0wYUtDnuImJFZOWnxvF772t_ausK5rzftFbpY220Lo985RMXDfZE9JvnTbJ5N88SnpEuMYtwx3deg2oCylpaqBCtYaY47YSoqpHOcVM4oqwUwJlyluVJGMEcJH6Kbn7ceAFZN9DsbDytBZY_k3658YdQ</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Goldenberg, D. ; Kagan, M. ; Ravid, R. ; Tsirkin, M.S.</creator><creatorcontrib>Goldenberg, D. ; Kagan, M. ; Ravid, R. ; Tsirkin, M.S.</creatorcontrib><description>Sockets Direct Protocol (SDP) is a byte stream protocol that utilizes the capabilities of the InfiniBand fabric to transparently achieve performance gains for existing socket-based networked applications. In this paper we discuss an implementation of Zero Copy support for synchronous send()/recv() socket calls, that uses the remote DMA capability of InfiniBand for SDP data transfers. We added this support to the open-source implementation of SDP over InfiniBand. We evaluate this implementation over a 20 Gb/s InfiniBand link. We demonstrate scalability of Zero Copy and show its benefits for systems that utilize multiple socket connections in parallel. For example, enabling Zero Copy with 8 active connections yields a bandwidth growth from 630MB/s to 1360MB/s, at the same time reducing the CPU utilization by a factor often</description><identifier>ISSN: 1552-5244</identifier><identifier>ISBN: 9780780394858</identifier><identifier>ISBN: 0780394852</identifier><identifier>EISSN: 2168-9253</identifier><identifier>EISBN: 9780780394865</identifier><identifier>EISBN: 0780394860</identifier><identifier>DOI: 10.1109/CLUSTR.2005.347027</identifier><language>eng</language><publisher>IEEE</publisher><subject>Bandwidth ; Delay ; Engines ; Fabrics ; Kernel ; Open source software ; Protocols ; Radio access networks ; Sockets ; Switches</subject><ispartof>2005 IEEE International Conference on Cluster Computing, 2005, p.1-10</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4154155$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2051,27904,54898</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4154155$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Goldenberg, D.</creatorcontrib><creatorcontrib>Kagan, M.</creatorcontrib><creatorcontrib>Ravid, R.</creatorcontrib><creatorcontrib>Tsirkin, M.S.</creatorcontrib><title>Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links</title><title>2005 IEEE International Conference on Cluster Computing</title><addtitle>CLUSTR</addtitle><description>Sockets Direct Protocol (SDP) is a byte stream protocol that utilizes the capabilities of the InfiniBand fabric to transparently achieve performance gains for existing socket-based networked applications. In this paper we discuss an implementation of Zero Copy support for synchronous send()/recv() socket calls, that uses the remote DMA capability of InfiniBand for SDP data transfers. We added this support to the open-source implementation of SDP over InfiniBand. We evaluate this implementation over a 20 Gb/s InfiniBand link. We demonstrate scalability of Zero Copy and show its benefits for systems that utilize multiple socket connections in parallel. For example, enabling Zero Copy with 8 active connections yields a bandwidth growth from 630MB/s to 1360MB/s, at the same time reducing the CPU utilization by a factor often</description><subject>Bandwidth</subject><subject>Delay</subject><subject>Engines</subject><subject>Fabrics</subject><subject>Kernel</subject><subject>Open source software</subject><subject>Protocols</subject><subject>Radio access networks</subject><subject>Sockets</subject><subject>Switches</subject><issn>1552-5244</issn><issn>2168-9253</issn><isbn>9780780394858</isbn><isbn>0780394852</isbn><isbn>9780780394865</isbn><isbn>0780394860</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2005</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpVj9tKw0AQhtcTWGpfQG_2BdLueTeXNWotBBSb3nhTNpuprm2zYRMrfXtT1At_PhiY-Rj4EbqmZEwpSSdZvlwUL2NGiBxzoQnTJ2iUakN6eCqMkqdowKgyScokP_t3k-YcDaiULJFMiEs0atsP0oenXEs9QF9FtHXb2Ah1tz3gqXv3sPf1G158NhB9iHgR3AY6_AxxHeLO1g7wsj0arxADzkJz-FPufATXmzF0wYUtDnuImJFZOWnxvF772t_ausK5rzftFbpY220Lo985RMXDfZE9JvnTbJ5N88SnpEuMYtwx3deg2oCylpaqBCtYaY47YSoqpHOcVM4oqwUwJlyluVJGMEcJH6Kbn7ceAFZN9DsbDytBZY_k3658YdQ</recordid><startdate>200509</startdate><enddate>200509</enddate><creator>Goldenberg, D.</creator><creator>Kagan, M.</creator><creator>Ravid, R.</creator><creator>Tsirkin, M.S.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>200509</creationdate><title>Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links</title><author>Goldenberg, D. ; Kagan, M. ; Ravid, R. ; Tsirkin, M.S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i90t-8623c27485178e6aa1b6bea42b8485148d145cc30dc86a74e224cd7366842c103</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2005</creationdate><topic>Bandwidth</topic><topic>Delay</topic><topic>Engines</topic><topic>Fabrics</topic><topic>Kernel</topic><topic>Open source software</topic><topic>Protocols</topic><topic>Radio access networks</topic><topic>Sockets</topic><topic>Switches</topic><toplevel>online_resources</toplevel><creatorcontrib>Goldenberg, D.</creatorcontrib><creatorcontrib>Kagan, M.</creatorcontrib><creatorcontrib>Ravid, R.</creatorcontrib><creatorcontrib>Tsirkin, M.S.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Goldenberg, D.</au><au>Kagan, M.</au><au>Ravid, R.</au><au>Tsirkin, M.S.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links</atitle><btitle>2005 IEEE International Conference on Cluster Computing</btitle><stitle>CLUSTR</stitle><date>2005-09</date><risdate>2005</risdate><spage>1</spage><epage>10</epage><pages>1-10</pages><issn>1552-5244</issn><eissn>2168-9253</eissn><isbn>9780780394858</isbn><isbn>0780394852</isbn><eisbn>9780780394865</eisbn><eisbn>0780394860</eisbn><abstract>Sockets Direct Protocol (SDP) is a byte stream protocol that utilizes the capabilities of the InfiniBand fabric to transparently achieve performance gains for existing socket-based networked applications. In this paper we discuss an implementation of Zero Copy support for synchronous send()/recv() socket calls, that uses the remote DMA capability of InfiniBand for SDP data transfers. We added this support to the open-source implementation of SDP over InfiniBand. We evaluate this implementation over a 20 Gb/s InfiniBand link. We demonstrate scalability of Zero Copy and show its benefits for systems that utilize multiple socket connections in parallel. For example, enabling Zero Copy with 8 active connections yields a bandwidth growth from 630MB/s to 1360MB/s, at the same time reducing the CPU utilization by a factor often</abstract><pub>IEEE</pub><doi>10.1109/CLUSTR.2005.347027</doi><tpages>10</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1552-5244
ispartof 2005 IEEE International Conference on Cluster Computing, 2005, p.1-10
issn 1552-5244
2168-9253
language eng
recordid cdi_ieee_primary_4154155
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Bandwidth
Delay
Engines
Fabrics
Kernel
Open source software
Protocols
Radio access networks
Sockets
Switches
title Transparently Achieving Superior Socket Performance Using Zero Copy Socket Direct Protocol over 20Gb/s InfiniBand Links
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T04%3A33%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Transparently%20Achieving%20Superior%20Socket%20Performance%20Using%20Zero%20Copy%20Socket%20Direct%20Protocol%20over%2020Gb/s%20InfiniBand%20Links&rft.btitle=2005%20IEEE%20International%20Conference%20on%20Cluster%20Computing&rft.au=Goldenberg,%20D.&rft.date=2005-09&rft.spage=1&rft.epage=10&rft.pages=1-10&rft.issn=1552-5244&rft.eissn=2168-9253&rft.isbn=9780780394858&rft.isbn_list=0780394852&rft_id=info:doi/10.1109/CLUSTR.2005.347027&rft_dat=%3Cieee_6IE%3E4154155%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9780780394865&rft.eisbn_list=0780394860&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=4154155&rfr_iscdi=true