RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers
Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. The...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on communications 2021-12, Vol.69 (12), p.8363-8374 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 8374 |
---|---|
container_issue | 12 |
container_start_page | 8363 |
container_title | IEEE transactions on communications |
container_volume | 69 |
creator | Zou, Shaojun Huang, Jiawei Wang, Jianxin He, Tian |
description | Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes. |
doi_str_mv | 10.1109/TCOMM.2021.3118467 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2610982656</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9562525</ieee_id><sourcerecordid>2610982656</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</originalsourceid><addsrcrecordid>eNo9kM1OwzAQhC0EEqXwAnCxxDnFduqfcIOUFqRGlapytjbxBqUUp9jpgbcnoRWnWWlndkcfIbecTThn2cMmXxXFRDDBJynnZqr0GRlxKU3CjNTnZMRYxhKltbkkVzFuGWNTlqYjsl4X-SNdYxschsZ_0ALC56DgHc1bN4x1G-i88ZgsAvTi6LIFR59hB74a9o2nM-iA5ug7DPGaXNSwi3hz0jF5n79s8tdkuVq85U_LpBKZ7BKlQBuFWmdOG64rqPv2opTVlBuna2c0SqhAZMyVBmppFIeyFFIp7pDxMh2T--PdfWi_Dxg7u20PwfcvrVA9FCOUVL1LHF1VaGMMWNt9aL4g_FjO7MDO_rGzAzt7YteH7o6hBhH_A5lUQgqZ_gITDWke</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2610982656</pqid></control><display><type>article</type><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><source>IEEE Electronic Library (IEL)</source><creator>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</creator><creatorcontrib>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</creatorcontrib><description>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</description><identifier>ISSN: 0090-6778</identifier><identifier>EISSN: 1558-0857</identifier><identifier>DOI: 10.1109/TCOMM.2021.3118467</identifier><identifier>CODEN: IECMBT</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Asymmetry ; Coding ; Completion time ; Computer centers ; Data center ; Data centers ; Delays ; Encoding ; Load balancing ; marking ; network asymmetry ; Network latency ; Optimization ; Out of order ; packet reordering ; Redundancy ; Switches ; Topology ; Uncertainty</subject><ispartof>IEEE transactions on communications, 2021-12, Vol.69 (12), p.8363-8374</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</citedby><cites>FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</cites><orcidid>0000-0002-7578-4490 ; 0000-0003-1516-0480</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9562525$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9562525$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zou, Shaojun</creatorcontrib><creatorcontrib>Huang, Jiawei</creatorcontrib><creatorcontrib>Wang, Jianxin</creatorcontrib><creatorcontrib>He, Tian</creatorcontrib><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><title>IEEE transactions on communications</title><addtitle>TCOMM</addtitle><description>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</description><subject>Asymmetry</subject><subject>Coding</subject><subject>Completion time</subject><subject>Computer centers</subject><subject>Data center</subject><subject>Data centers</subject><subject>Delays</subject><subject>Encoding</subject><subject>Load balancing</subject><subject>marking</subject><subject>network asymmetry</subject><subject>Network latency</subject><subject>Optimization</subject><subject>Out of order</subject><subject>packet reordering</subject><subject>Redundancy</subject><subject>Switches</subject><subject>Topology</subject><subject>Uncertainty</subject><issn>0090-6778</issn><issn>1558-0857</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kM1OwzAQhC0EEqXwAnCxxDnFduqfcIOUFqRGlapytjbxBqUUp9jpgbcnoRWnWWlndkcfIbecTThn2cMmXxXFRDDBJynnZqr0GRlxKU3CjNTnZMRYxhKltbkkVzFuGWNTlqYjsl4X-SNdYxschsZ_0ALC56DgHc1bN4x1G-i88ZgsAvTi6LIFR59hB74a9o2nM-iA5ug7DPGaXNSwi3hz0jF5n79s8tdkuVq85U_LpBKZ7BKlQBuFWmdOG64rqPv2opTVlBuna2c0SqhAZMyVBmppFIeyFFIp7pDxMh2T--PdfWi_Dxg7u20PwfcvrVA9FCOUVL1LHF1VaGMMWNt9aL4g_FjO7MDO_rGzAzt7YteH7o6hBhH_A5lUQgqZ_gITDWke</recordid><startdate>20211201</startdate><enddate>20211201</enddate><creator>Zou, Shaojun</creator><creator>Huang, Jiawei</creator><creator>Wang, Jianxin</creator><creator>He, Tian</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-7578-4490</orcidid><orcidid>https://orcid.org/0000-0003-1516-0480</orcidid></search><sort><creationdate>20211201</creationdate><title>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</title><author>Zou, Shaojun ; Huang, Jiawei ; Wang, Jianxin ; He, Tian</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-66a786e779d7817caf0212b5c418d7fd87e5aca290db8af5861abb25661de01b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Asymmetry</topic><topic>Coding</topic><topic>Completion time</topic><topic>Computer centers</topic><topic>Data center</topic><topic>Data centers</topic><topic>Delays</topic><topic>Encoding</topic><topic>Load balancing</topic><topic>marking</topic><topic>network asymmetry</topic><topic>Network latency</topic><topic>Optimization</topic><topic>Out of order</topic><topic>packet reordering</topic><topic>Redundancy</topic><topic>Switches</topic><topic>Topology</topic><topic>Uncertainty</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zou, Shaojun</creatorcontrib><creatorcontrib>Huang, Jiawei</creatorcontrib><creatorcontrib>Wang, Jianxin</creatorcontrib><creatorcontrib>He, Tian</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on communications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zou, Shaojun</au><au>Huang, Jiawei</au><au>Wang, Jianxin</au><au>He, Tian</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers</atitle><jtitle>IEEE transactions on communications</jtitle><stitle>TCOMM</stitle><date>2021-12-01</date><risdate>2021</risdate><volume>69</volume><issue>12</issue><spage>8363</spage><epage>8374</epage><pages>8363-8374</pages><issn>0090-6778</issn><eissn>1558-0857</eissn><coden>IECMBT</coden><abstract>Data center networks typically adopt multi-rooted tree topologies to provide high bisection bandwidth. Various fine-grained load balancing schemes have been proposed to split flows across multiple paths. However, data center networks suffer from many uncertainties such as highly dynamic traffic. These uncertainties easily make network become asymmetric, resulting in significant packet reordering. Unfortunately, existing solutions passively deal with packet reordering based on a threshold and hardly adapt to asymmetric networks because of lacking the explicit reordering feedback. These solutions either fail to quickly respond to packet loss or cause unnecessary fast retransmission, which reduces link utilization and increases flow completion time. In this paper, we propose a fine-grained load balancing scheme RMC to eliminate the impact of packet reordering and handle uncertainties in asymmetric networks. To avoid unnecessary fast retransmission, the switch proactively identifies reordered packet according to local queue length and global path latency. Furthermore, we employ a coding technique with redundancy optimization to reduce long-tailed flow completion time under network asymmetry. Through a series of large-scale NS2 simulations and testbed experiments, we demonstrate that RMC effectively avoids unnecessary fast retransmission under different network scenarios and reduces flow completion time by up to 72% compared with state-of-the-art schemes.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCOMM.2021.3118467</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-7578-4490</orcidid><orcidid>https://orcid.org/0000-0003-1516-0480</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0090-6778 |
ispartof | IEEE transactions on communications, 2021-12, Vol.69 (12), p.8363-8374 |
issn | 0090-6778 1558-0857 |
language | eng |
recordid | cdi_proquest_journals_2610982656 |
source | IEEE Electronic Library (IEL) |
subjects | Asymmetry Coding Completion time Computer centers Data center Data centers Delays Encoding Load balancing marking network asymmetry Network latency Optimization Out of order packet reordering Redundancy Switches Topology Uncertainty |
title | RMC: Reordering Marking and Coding for Fine-Grained Load Balancing in Data Centers |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T07%3A27%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RMC:%20Reordering%20Marking%20and%20Coding%20for%20Fine-Grained%20Load%20Balancing%20in%20Data%20Centers&rft.jtitle=IEEE%20transactions%20on%20communications&rft.au=Zou,%20Shaojun&rft.date=2021-12-01&rft.volume=69&rft.issue=12&rft.spage=8363&rft.epage=8374&rft.pages=8363-8374&rft.issn=0090-6778&rft.eissn=1558-0857&rft.coden=IECMBT&rft_id=info:doi/10.1109/TCOMM.2021.3118467&rft_dat=%3Cproquest_RIE%3E2610982656%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2610982656&rft_id=info:pmid/&rft_ieee_id=9562525&rfr_iscdi=true |