Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters

Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE eTransactions on network and service management 2016-03, Vol.13 (1), p.5-18
Hauptverfasser: Wei Wang, Yi Sun, Salamatian, Kave, Zhongcheng Li
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 18
container_issue 1
container_start_page 5
container_title IEEE eTransactions on network and service management
container_volume 13
creator Wei Wang
Yi Sun
Salamatian, Kave
Zhongcheng Li
description Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.
doi_str_mv 10.1109/TNSM.2016.2517087
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_1786941393</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7378988</ieee_id><sourcerecordid>4045665641</sourcerecordid><originalsourceid>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</originalsourceid><addsrcrecordid>eNpdkV9LwzAUxYsoOKcfQHwJ-KIPnblN2ySPY3_cYFPBvYc0zVxG19Qmm-7b21IZ4tO9HH7nci4nCG4BDwAwf1q9vC8HEYZ0ECVAMaNnQQ84icI4IfT8z34ZXDm3xThhwKNeIIa5rLw5aPQm_QbNnS2kN7ZEa1ujSaGrjSw9kmWOlkZpNC3sl0PZEU2-q8Iab8qPzjhuTtTO-CMyJRpLL5UufaNcBxdrWTh98zv7wWo6WY1m4eL1eT4aLkIVR6kPUyUVB5U0r2SwVinEVCcpqCZ2zglNgQIQJQmXaZ4RnGOsaK4xlhnhjFPSDx67sxtZiKo2O1kfhZVGzIYL0WoYCKWcwQEa9qFjq9p-7rXzYmec0kUhS233TgCDhHPAuEXv_6Fbu6_L5hEBlKU8BsJJQ0FHqdo6V-v1KQFg0bYj2nZE2474bafx3HUeo7U-8ZRQxhkjPx8viTo</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1786941393</pqid></control><display><type>article</type><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><source>IEEE Electronic Library (IEL)</source><creator>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</creator><creatorcontrib>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</creatorcontrib><description>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</description><identifier>ISSN: 1932-4537</identifier><identifier>EISSN: 1932-4537</identifier><identifier>DOI: 10.1109/TNSM.2016.2517087</identifier><identifier>CODEN: ITNSC4</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Computer Science ; Data Center Network ; Data centers ; Deadlines ; Delays ; Elephants ; Freeways ; Heuristic algorithms ; Loads (forces) ; Mice ; Multipath ; Networking and Internet Architecture ; Networks ; Partitioning algorithms ; Path Partition ; Production scheduling ; Scheduling ; Scheduling algorithms ; Switches ; Switching theory ; Throughput ; Traffic control</subject><ispartof>IEEE eTransactions on network and service management, 2016-03, Vol.13 (1), p.5-18</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</citedby><cites>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</cites><orcidid>0000-0001-5557-9134</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7378988$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,780,784,796,885,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7378988$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://hal.science/hal-01377981$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Wei Wang</creatorcontrib><creatorcontrib>Yi Sun</creatorcontrib><creatorcontrib>Salamatian, Kave</creatorcontrib><creatorcontrib>Zhongcheng Li</creatorcontrib><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><title>IEEE eTransactions on network and service management</title><addtitle>T-NSM</addtitle><description>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</description><subject>Computer Science</subject><subject>Data Center Network</subject><subject>Data centers</subject><subject>Deadlines</subject><subject>Delays</subject><subject>Elephants</subject><subject>Freeways</subject><subject>Heuristic algorithms</subject><subject>Loads (forces)</subject><subject>Mice</subject><subject>Multipath</subject><subject>Networking and Internet Architecture</subject><subject>Networks</subject><subject>Partitioning algorithms</subject><subject>Path Partition</subject><subject>Production scheduling</subject><subject>Scheduling</subject><subject>Scheduling algorithms</subject><subject>Switches</subject><subject>Switching theory</subject><subject>Throughput</subject><subject>Traffic control</subject><issn>1932-4537</issn><issn>1932-4537</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkV9LwzAUxYsoOKcfQHwJ-KIPnblN2ySPY3_cYFPBvYc0zVxG19Qmm-7b21IZ4tO9HH7nci4nCG4BDwAwf1q9vC8HEYZ0ECVAMaNnQQ84icI4IfT8z34ZXDm3xThhwKNeIIa5rLw5aPQm_QbNnS2kN7ZEa1ujSaGrjSw9kmWOlkZpNC3sl0PZEU2-q8Iab8qPzjhuTtTO-CMyJRpLL5UufaNcBxdrWTh98zv7wWo6WY1m4eL1eT4aLkIVR6kPUyUVB5U0r2SwVinEVCcpqCZ2zglNgQIQJQmXaZ4RnGOsaK4xlhnhjFPSDx67sxtZiKo2O1kfhZVGzIYL0WoYCKWcwQEa9qFjq9p-7rXzYmec0kUhS233TgCDhHPAuEXv_6Fbu6_L5hEBlKU8BsJJQ0FHqdo6V-v1KQFg0bYj2nZE2474bafx3HUeo7U-8ZRQxhkjPx8viTo</recordid><startdate>201603</startdate><enddate>201603</enddate><creator>Wei Wang</creator><creator>Yi Sun</creator><creator>Salamatian, Kave</creator><creator>Zhongcheng Li</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>1XC</scope><orcidid>https://orcid.org/0000-0001-5557-9134</orcidid></search><sort><creationdate>201603</creationdate><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><author>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Computer Science</topic><topic>Data Center Network</topic><topic>Data centers</topic><topic>Deadlines</topic><topic>Delays</topic><topic>Elephants</topic><topic>Freeways</topic><topic>Heuristic algorithms</topic><topic>Loads (forces)</topic><topic>Mice</topic><topic>Multipath</topic><topic>Networking and Internet Architecture</topic><topic>Networks</topic><topic>Partitioning algorithms</topic><topic>Path Partition</topic><topic>Production scheduling</topic><topic>Scheduling</topic><topic>Scheduling algorithms</topic><topic>Switches</topic><topic>Switching theory</topic><topic>Throughput</topic><topic>Traffic control</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wei Wang</creatorcontrib><creatorcontrib>Yi Sun</creatorcontrib><creatorcontrib>Salamatian, Kave</creatorcontrib><creatorcontrib>Zhongcheng Li</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Hyper Article en Ligne (HAL)</collection><jtitle>IEEE eTransactions on network and service management</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wei Wang</au><au>Yi Sun</au><au>Salamatian, Kave</au><au>Zhongcheng Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</atitle><jtitle>IEEE eTransactions on network and service management</jtitle><stitle>T-NSM</stitle><date>2016-03</date><risdate>2016</risdate><volume>13</volume><issue>1</issue><spage>5</spage><epage>18</epage><pages>5-18</pages><issn>1932-4537</issn><eissn>1932-4537</eissn><coden>ITNSC4</coden><abstract>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TNSM.2016.2517087</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0001-5557-9134</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1932-4537
ispartof IEEE eTransactions on network and service management, 2016-03, Vol.13 (1), p.5-18
issn 1932-4537
1932-4537
language eng
recordid cdi_proquest_journals_1786941393
source IEEE Electronic Library (IEL)
subjects Computer Science
Data Center Network
Data centers
Deadlines
Delays
Elephants
Freeways
Heuristic algorithms
Loads (forces)
Mice
Multipath
Networking and Internet Architecture
Networks
Partitioning algorithms
Path Partition
Production scheduling
Scheduling
Scheduling algorithms
Switches
Switching theory
Throughput
Traffic control
title Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T03%3A38%3A15IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Adaptive%20Path%20Isolation%20for%20Elephant%20and%20Mice%20Flows%20by%20Exploiting%20Path%20Diversity%20in%20Datacenters&rft.jtitle=IEEE%20eTransactions%20on%20network%20and%20service%20management&rft.au=Wei%20Wang&rft.date=2016-03&rft.volume=13&rft.issue=1&rft.spage=5&rft.epage=18&rft.pages=5-18&rft.issn=1932-4537&rft.eissn=1932-4537&rft.coden=ITNSC4&rft_id=info:doi/10.1109/TNSM.2016.2517087&rft_dat=%3Cproquest_RIE%3E4045665641%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1786941393&rft_id=info:pmid/&rft_ieee_id=7378988&rfr_iscdi=true