Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters
Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling...
Gespeichert in:
Veröffentlicht in: | IEEE eTransactions on network and service management 2016-03, Vol.13 (1), p.5-18 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 18 |
---|---|
container_issue | 1 |
container_start_page | 5 |
container_title | IEEE eTransactions on network and service management |
container_volume | 13 |
creator | Wei Wang Yi Sun Salamatian, Kave Zhongcheng Li |
description | Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking. |
doi_str_mv | 10.1109/TNSM.2016.2517087 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_1786941393</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7378988</ieee_id><sourcerecordid>4045665641</sourcerecordid><originalsourceid>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</originalsourceid><addsrcrecordid>eNpdkV9LwzAUxYsoOKcfQHwJ-KIPnblN2ySPY3_cYFPBvYc0zVxG19Qmm-7b21IZ4tO9HH7nci4nCG4BDwAwf1q9vC8HEYZ0ECVAMaNnQQ84icI4IfT8z34ZXDm3xThhwKNeIIa5rLw5aPQm_QbNnS2kN7ZEa1ujSaGrjSw9kmWOlkZpNC3sl0PZEU2-q8Iab8qPzjhuTtTO-CMyJRpLL5UufaNcBxdrWTh98zv7wWo6WY1m4eL1eT4aLkIVR6kPUyUVB5U0r2SwVinEVCcpqCZ2zglNgQIQJQmXaZ4RnGOsaK4xlhnhjFPSDx67sxtZiKo2O1kfhZVGzIYL0WoYCKWcwQEa9qFjq9p-7rXzYmec0kUhS233TgCDhHPAuEXv_6Fbu6_L5hEBlKU8BsJJQ0FHqdo6V-v1KQFg0bYj2nZE2474bafx3HUeo7U-8ZRQxhkjPx8viTo</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1786941393</pqid></control><display><type>article</type><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><source>IEEE Electronic Library (IEL)</source><creator>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</creator><creatorcontrib>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</creatorcontrib><description>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</description><identifier>ISSN: 1932-4537</identifier><identifier>EISSN: 1932-4537</identifier><identifier>DOI: 10.1109/TNSM.2016.2517087</identifier><identifier>CODEN: ITNSC4</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Computer Science ; Data Center Network ; Data centers ; Deadlines ; Delays ; Elephants ; Freeways ; Heuristic algorithms ; Loads (forces) ; Mice ; Multipath ; Networking and Internet Architecture ; Networks ; Partitioning algorithms ; Path Partition ; Production scheduling ; Scheduling ; Scheduling algorithms ; Switches ; Switching theory ; Throughput ; Traffic control</subject><ispartof>IEEE eTransactions on network and service management, 2016-03, Vol.13 (1), p.5-18</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</citedby><cites>FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</cites><orcidid>0000-0001-5557-9134</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7378988$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,780,784,796,885,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7378988$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://hal.science/hal-01377981$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Wei Wang</creatorcontrib><creatorcontrib>Yi Sun</creatorcontrib><creatorcontrib>Salamatian, Kave</creatorcontrib><creatorcontrib>Zhongcheng Li</creatorcontrib><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><title>IEEE eTransactions on network and service management</title><addtitle>T-NSM</addtitle><description>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</description><subject>Computer Science</subject><subject>Data Center Network</subject><subject>Data centers</subject><subject>Deadlines</subject><subject>Delays</subject><subject>Elephants</subject><subject>Freeways</subject><subject>Heuristic algorithms</subject><subject>Loads (forces)</subject><subject>Mice</subject><subject>Multipath</subject><subject>Networking and Internet Architecture</subject><subject>Networks</subject><subject>Partitioning algorithms</subject><subject>Path Partition</subject><subject>Production scheduling</subject><subject>Scheduling</subject><subject>Scheduling algorithms</subject><subject>Switches</subject><subject>Switching theory</subject><subject>Throughput</subject><subject>Traffic control</subject><issn>1932-4537</issn><issn>1932-4537</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkV9LwzAUxYsoOKcfQHwJ-KIPnblN2ySPY3_cYFPBvYc0zVxG19Qmm-7b21IZ4tO9HH7nci4nCG4BDwAwf1q9vC8HEYZ0ECVAMaNnQQ84icI4IfT8z34ZXDm3xThhwKNeIIa5rLw5aPQm_QbNnS2kN7ZEa1ujSaGrjSw9kmWOlkZpNC3sl0PZEU2-q8Iab8qPzjhuTtTO-CMyJRpLL5UufaNcBxdrWTh98zv7wWo6WY1m4eL1eT4aLkIVR6kPUyUVB5U0r2SwVinEVCcpqCZ2zglNgQIQJQmXaZ4RnGOsaK4xlhnhjFPSDx67sxtZiKo2O1kfhZVGzIYL0WoYCKWcwQEa9qFjq9p-7rXzYmec0kUhS233TgCDhHPAuEXv_6Fbu6_L5hEBlKU8BsJJQ0FHqdo6V-v1KQFg0bYj2nZE2474bafx3HUeo7U-8ZRQxhkjPx8viTo</recordid><startdate>201603</startdate><enddate>201603</enddate><creator>Wei Wang</creator><creator>Yi Sun</creator><creator>Salamatian, Kave</creator><creator>Zhongcheng Li</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>1XC</scope><orcidid>https://orcid.org/0000-0001-5557-9134</orcidid></search><sort><creationdate>201603</creationdate><title>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</title><author>Wei Wang ; Yi Sun ; Salamatian, Kave ; Zhongcheng Li</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c426t-6cac91c5109b1fc6147e561c193d937617113ca39a6db30d00c7de00ab398973</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Computer Science</topic><topic>Data Center Network</topic><topic>Data centers</topic><topic>Deadlines</topic><topic>Delays</topic><topic>Elephants</topic><topic>Freeways</topic><topic>Heuristic algorithms</topic><topic>Loads (forces)</topic><topic>Mice</topic><topic>Multipath</topic><topic>Networking and Internet Architecture</topic><topic>Networks</topic><topic>Partitioning algorithms</topic><topic>Path Partition</topic><topic>Production scheduling</topic><topic>Scheduling</topic><topic>Scheduling algorithms</topic><topic>Switches</topic><topic>Switching theory</topic><topic>Throughput</topic><topic>Traffic control</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wei Wang</creatorcontrib><creatorcontrib>Yi Sun</creatorcontrib><creatorcontrib>Salamatian, Kave</creatorcontrib><creatorcontrib>Zhongcheng Li</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Hyper Article en Ligne (HAL)</collection><jtitle>IEEE eTransactions on network and service management</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wei Wang</au><au>Yi Sun</au><au>Salamatian, Kave</au><au>Zhongcheng Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters</atitle><jtitle>IEEE eTransactions on network and service management</jtitle><stitle>T-NSM</stitle><date>2016-03</date><risdate>2016</risdate><volume>13</volume><issue>1</issue><spage>5</spage><epage>18</epage><pages>5-18</pages><issn>1932-4537</issn><eissn>1932-4537</eissn><coden>ITNSC4</coden><abstract>Resource competition and conflicts in datacenter networks (DCNs) are frequent and intense. They become inevitable when mixing elephant and mice flows on shared transmission paths, resulting in arbitration between throughput and latency and performance degradation. We propose a novel flow scheduling scheme, Freeway, that leverages on path diversity in the DCN topology to guarantee, simultaneously, mice flow completion within deadline and high network utilization. Freeway adaptively partitions the available paths into low latency and high throughput paths and provides different transmission services for each category. A M/G/1-based model is developed to theoretically obtain the highest value of average delay over the path that will guarantee for 99% of mice flows their completion time before the deadline. Based on this bound, Freeway proposes a dynamic path partitioning algorithm to adjust dynamically with varying traffic load the number of low latency and high throughput paths. While mice flows are transmitted over low latency paths using a simple equal cost multiple path (ECMP) scheduling, Freeway load balances elephant flows on different high-throughput paths. We evaluate Freeway in a series of simulation on a large scale topology and use real traces. Our evaluation results show that Freeway significantly reduces the mice flows completion time within deadlines, while achieving remarkable throughput compared with current schemes. It is remarkable that Freeway does not need any change of DCN switch fabrics or scheduling algorithms and can be deployed easily on any generic datacenter network with switches implementing VLANs and trunking.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TNSM.2016.2517087</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0001-5557-9134</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1932-4537 |
ispartof | IEEE eTransactions on network and service management, 2016-03, Vol.13 (1), p.5-18 |
issn | 1932-4537 1932-4537 |
language | eng |
recordid | cdi_proquest_journals_1786941393 |
source | IEEE Electronic Library (IEL) |
subjects | Computer Science Data Center Network Data centers Deadlines Delays Elephants Freeways Heuristic algorithms Loads (forces) Mice Multipath Networking and Internet Architecture Networks Partitioning algorithms Path Partition Production scheduling Scheduling Scheduling algorithms Switches Switching theory Throughput Traffic control |
title | Adaptive Path Isolation for Elephant and Mice Flows by Exploiting Path Diversity in Datacenters |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T03%3A38%3A15IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Adaptive%20Path%20Isolation%20for%20Elephant%20and%20Mice%20Flows%20by%20Exploiting%20Path%20Diversity%20in%20Datacenters&rft.jtitle=IEEE%20eTransactions%20on%20network%20and%20service%20management&rft.au=Wei%20Wang&rft.date=2016-03&rft.volume=13&rft.issue=1&rft.spage=5&rft.epage=18&rft.pages=5-18&rft.issn=1932-4537&rft.eissn=1932-4537&rft.coden=ITNSC4&rft_id=info:doi/10.1109/TNSM.2016.2517087&rft_dat=%3Cproquest_RIE%3E4045665641%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1786941393&rft_id=info:pmid/&rft_ieee_id=7378988&rfr_iscdi=true |