RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers

Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. The...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on communications 2021-12, Vol.69 (12), p.8363-8374
Hauptverfasser: Zou, Shaojun, Huang, Jiawei, Wang, Jianxin, He, Tian
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 8374
container_issue 12
container_start_page 8363
container_title IEEE transactions on communications
container_volume 69
creator Zou, Shaojun
Huang, Jiawei
Wang, Jianxin
He, Tian
description Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.
doi_str_mv 10.1109/TCOMM.2021.3118467
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2610982656</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9562525</ieee_id><sourcerecordid>2610982656</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</originalsourceid><addsrcrecordid>eNo9kM1OwzAQhC0EEqXwAnCxxDnFduqfcIOUFqRGlapytjbxBqUUp9jpgbcnoRWnWWlndkcfIbecTThn2cMmXxXFRDDBJynnZqr0GRlxKU3CjNTnZMRYxhKltbkkVzFuGWNTlqYjsl4X-SNdYxschsZ_0ALC56DgHc1bN4x1G-i88ZgsAvTi6LIFR59hB74a9o2nM-iA5ug7DPGaXNSwi3hz0jF5n79s8tdkuVq85U_LpBKZ7BKlQBuFWmdOG64rqPv2opTVlBuna2c0SqhAZMyVBmppFIeyFFIp7pDxMh2T--PdfWi_Dxg7u20PwfcvrVA9FCOUVL1LHF1VaGMMWNt9aL4g_FjO7MDO_rGzAzt7YteH7o6hBhH_A5lUQgqZ_gITDWke</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2610982656</pqid></control><display><type>article</type><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><source>IEEE Electronic Library (IEL)</source><creator>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</creator><creatorcontrib>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</creatorcontrib><description>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</description><identifier>ISSN: 0090-6778</identifier><identifier>EISSN: 1558-0857</identifier><identifier>DOI: 10.1109/TCOMM.2021.3118467</identifier><identifier>CODEN: IECMBT</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Asymmetry ; Coding ; Completion time ; Computer centers ; Data center ; Data centers ; Delays ; Encoding ; Load balancing ; marking ; network asymmetry ; Network latency ; Optimization ; Out of order ; packet reordering ; Redundancy ; Switches ; Topology ; Uncertainty</subject><ispartof>IEEE transactions on communications, 2021-12, Vol.69 (12), p.8363-8374</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</citedby><cites>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</cites><orcidid>0000-0002-7578-4490 ; 0000-0003-1516-0480</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9562525$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9562525$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zou, Shaojun</creatorcontrib><creatorcontrib>Huang, Jiawei</creatorcontrib><creatorcontrib>Wang, Jianxin</creatorcontrib><creatorcontrib>He, Tian</creatorcontrib><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><title>IEEE transactions on communications</title><addtitle>TCOMM</addtitle><description>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</description><subject>Asymmetry</subject><subject>Coding</subject><subject>Completion time</subject><subject>Computer centers</subject><subject>Data center</subject><subject>Data centers</subject><subject>Delays</subject><subject>Encoding</subject><subject>Load balancing</subject><subject>marking</subject><subject>network asymmetry</subject><subject>Network latency</subject><subject>Optimization</subject><subject>Out of order</subject><subject>packet reordering</subject><subject>Redundancy</subject><subject>Switches</subject><subject>Topology</subject><subject>Uncertainty</subject><issn>0090-6778</issn><issn>1558-0857</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kM1OwzAQhC0EEqXwAnCxxDnFduqfcIOUFqRGlapytjbxBqUUp9jpgbcnoRWnWWlndkcfIbecTThn2cMmXxXFRDDBJynnZqr0GRlxKU3CjNTnZMRYxhKltbkkVzFuGWNTlqYjsl4X-SNdYxschsZ_0ALC56DgHc1bN4x1G-i88ZgsAvTi6LIFR59hB74a9o2nM-iA5ug7DPGaXNSwi3hz0jF5n79s8tdkuVq85U_LpBKZ7BKlQBuFWmdOG64rqPv2opTVlBuna2c0SqhAZMyVBmppFIeyFFIp7pDxMh2T--PdfWi_Dxg7u20PwfcvrVA9FCOUVL1LHF1VaGMMWNt9aL4g_FjO7MDO_rGzAzt7YteH7o6hBhH_A5lUQgqZ_gITDWke</recordid><startdate>20211201</startdate><enddate>20211201</enddate><creator>Zou, Shaojun</creator><creator>Huang, Jiawei</creator><creator>Wang, Jianxin</creator><creator>He, Tian</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-7578-4490</orcidid><orcidid>https://orcid.org/0000-0003-1516-0480</orcidid></search><sort><creationdate>20211201</creationdate><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><author>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Asymmetry</topic><topic>Coding</topic><topic>Completion time</topic><topic>Computer centers</topic><topic>Data center</topic><topic>Data centers</topic><topic>Delays</topic><topic>Encoding</topic><topic>Load balancing</topic><topic>marking</topic><topic>network asymmetry</topic><topic>Network latency</topic><topic>Optimization</topic><topic>Out of order</topic><topic>packet reordering</topic><topic>Redundancy</topic><topic>Switches</topic><topic>Topology</topic><topic>Uncertainty</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zou, Shaojun</creatorcontrib><creatorcontrib>Huang, Jiawei</creatorcontrib><creatorcontrib>Wang, Jianxin</creatorcontrib><creatorcontrib>He, Tian</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on communications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zou, Shaojun</au><au>Huang, Jiawei</au><au>Wang, Jianxin</au><au>He, Tian</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</atitle><jtitle>IEEE transactions on communications</jtitle><stitle>TCOMM</stitle><date>2021-12-01</date><risdate>2021</risdate><volume>69</volume><issue>12</issue><spage>8363</spage><epage>8374</epage><pages>8363-8374</pages><issn>0090-6778</issn><eissn>1558-0857</eissn><coden>IECMBT</coden><abstract>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCOMM.2021.3118467</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-7578-4490</orcidid><orcidid>https://orcid.org/0000-0003-1516-0480</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0090-6778
ispartof IEEE transactions on communications, 2021-12, Vol.69 (12), p.8363-8374
issn 0090-6778
1558-0857
language eng
recordid cdi_proquest_journals_2610982656
source IEEE Electronic Library (IEL)
subjects Asymmetry
Coding
Completion time
Computer centers
Data center
Data centers
Delays
Encoding
Load balancing
marking
network asymmetry
Network latency
Optimization
Out of order
packet reordering
Redundancy
Switches
Topology
Uncertainty
title RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T07%3A27%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RMC:%20Reordering%20Marking%20and%20Coding%20for%20Fine-Grained%20Load%20Balancing%20in%20Data%20Centers&rft.jtitle=IEEE%20transactions%20on%20communications&rft.au=Zou,%20Shaojun&rft.date=2021-12-01&rft.volume=69&rft.issue=12&rft.spage=8363&rft.epage=8374&rft.pages=8363-8374&rft.issn=0090-6778&rft.eissn=1558-0857&rft.coden=IECMBT&rft_id=info:doi/10.1109/TCOMM.2021.3118467&rft_dat=%3Cproquest_RIE%3E2610982656%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2610982656&rft_id=info:pmid/&rft_ieee_id=9562525&rfr_iscdi=true