HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6
With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes i...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Tagungsbericht |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 220 |
---|---|
container_issue | |
container_start_page | 209 |
container_title | |
container_volume | |
creator | Chentao Wu Xubin He Guanying Wu Shenggang Wan Xiaohua Liu Qiang Cao Changsheng Xie |
description | With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes. |
doi_str_mv | 10.1109/DSN.2011.5958220 |
format | Conference Proceeding |
fullrecord | <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_5958220</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5958220</ieee_id><sourcerecordid>5958220</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-f16f7380a13d2a00b2808a80329c7e0e51c08c3b76ac809fb93ee316910937e83</originalsourceid><addsrcrecordid>eNpVkE9rwkAUxLf_oGK9F3rZL7D63q7ZfdubGFsFqdLas7zEjWyJicRc9NM3UC-dyxxmGIafEM8IQ0Two_TrY6gBcZj4hLSGGzHwjnCsx2OvjbG3oqcxIWW8dnf_Mu3vRQ8TAwqI_KMYnE4_0MlaD5Z6YjNP1zKvd-FVTuS8buKlrlouVRp5X1dcyjU3sT3LaVeRbS1XxzYe4iXIxWgly5p3MuOSqzxWexkr-TlZpMo-iYeCy1MYXL0vvt9mm-lcLVfvi-lkqSK6pFUF2sIZAkaz0wyQaQJigu507gKEBHOg3GTOck7gi8ybEAxa3yExLpDpi5e_3RhC2B6beODmvL0yMr_ERVIo</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</creator><creatorcontrib>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</creatorcontrib><description>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</description><identifier>ISSN: 1530-0889</identifier><identifier>ISBN: 9781424492329</identifier><identifier>ISBN: 1424492327</identifier><identifier>EISSN: 2158-3927</identifier><identifier>EISBN: 9781424492336</identifier><identifier>EISBN: 1424492319</identifier><identifier>EISBN: 9781424492312</identifier><identifier>EISBN: 1424492335</identifier><identifier>DOI: 10.1109/DSN.2011.5958220</identifier><language>eng</language><publisher>IEEE</publisher><subject>Arrays ; Diagonal/Anti-diagonal Parity ; Encoding ; Equations ; Horizontal Parity ; Layout ; Load Balancing ; Load management ; Mathematical model ; MDS Code ; Performance Evaluation ; RAID-6 ; Reliability</subject><ispartof>2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN), 2011, p.209-220</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5958220$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5958220$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Chentao Wu</creatorcontrib><creatorcontrib>Xubin He</creatorcontrib><creatorcontrib>Guanying Wu</creatorcontrib><creatorcontrib>Shenggang Wan</creatorcontrib><creatorcontrib>Xiaohua Liu</creatorcontrib><creatorcontrib>Qiang Cao</creatorcontrib><creatorcontrib>Changsheng Xie</creatorcontrib><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><title>2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN)</title><addtitle>DSN</addtitle><description>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</description><subject>Arrays</subject><subject>Diagonal/Anti-diagonal Parity</subject><subject>Encoding</subject><subject>Equations</subject><subject>Horizontal Parity</subject><subject>Layout</subject><subject>Load Balancing</subject><subject>Load management</subject><subject>Mathematical model</subject><subject>MDS Code</subject><subject>Performance Evaluation</subject><subject>RAID-6</subject><subject>Reliability</subject><issn>1530-0889</issn><issn>2158-3927</issn><isbn>9781424492329</isbn><isbn>1424492327</isbn><isbn>9781424492336</isbn><isbn>1424492319</isbn><isbn>9781424492312</isbn><isbn>1424492335</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2011</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpVkE9rwkAUxLf_oGK9F3rZL7D63q7ZfdubGFsFqdLas7zEjWyJicRc9NM3UC-dyxxmGIafEM8IQ0Two_TrY6gBcZj4hLSGGzHwjnCsx2OvjbG3oqcxIWW8dnf_Mu3vRQ8TAwqI_KMYnE4_0MlaD5Z6YjNP1zKvd-FVTuS8buKlrlouVRp5X1dcyjU3sT3LaVeRbS1XxzYe4iXIxWgly5p3MuOSqzxWexkr-TlZpMo-iYeCy1MYXL0vvt9mm-lcLVfvi-lkqSK6pFUF2sIZAkaz0wyQaQJigu507gKEBHOg3GTOck7gi8ybEAxa3yExLpDpi5e_3RhC2B6beODmvL0yMr_ERVIo</recordid><startdate>201106</startdate><enddate>201106</enddate><creator>Chentao Wu</creator><creator>Xubin He</creator><creator>Guanying Wu</creator><creator>Shenggang Wan</creator><creator>Xiaohua Liu</creator><creator>Qiang Cao</creator><creator>Changsheng Xie</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>201106</creationdate><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><author>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-f16f7380a13d2a00b2808a80329c7e0e51c08c3b76ac809fb93ee316910937e83</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2011</creationdate><topic>Arrays</topic><topic>Diagonal/Anti-diagonal Parity</topic><topic>Encoding</topic><topic>Equations</topic><topic>Horizontal Parity</topic><topic>Layout</topic><topic>Load Balancing</topic><topic>Load management</topic><topic>Mathematical model</topic><topic>MDS Code</topic><topic>Performance Evaluation</topic><topic>RAID-6</topic><topic>Reliability</topic><toplevel>online_resources</toplevel><creatorcontrib>Chentao Wu</creatorcontrib><creatorcontrib>Xubin He</creatorcontrib><creatorcontrib>Guanying Wu</creatorcontrib><creatorcontrib>Shenggang Wan</creatorcontrib><creatorcontrib>Xiaohua Liu</creatorcontrib><creatorcontrib>Qiang Cao</creatorcontrib><creatorcontrib>Changsheng Xie</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chentao Wu</au><au>Xubin He</au><au>Guanying Wu</au><au>Shenggang Wan</au><au>Xiaohua Liu</au><au>Qiang Cao</au><au>Changsheng Xie</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</atitle><btitle>2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN)</btitle><stitle>DSN</stitle><date>2011-06</date><risdate>2011</risdate><spage>209</spage><epage>220</epage><pages>209-220</pages><issn>1530-0889</issn><eissn>2158-3927</eissn><isbn>9781424492329</isbn><isbn>1424492327</isbn><eisbn>9781424492336</eisbn><eisbn>1424492319</eisbn><eisbn>9781424492312</eisbn><eisbn>1424492335</eisbn><abstract>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</abstract><pub>IEEE</pub><doi>10.1109/DSN.2011.5958220</doi><tpages>12</tpages></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1530-0889 |
ispartof | 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN), 2011, p.209-220 |
issn | 1530-0889 2158-3927 |
language | eng |
recordid | cdi_ieee_primary_5958220 |
source | IEEE Electronic Library (IEL) Conference Proceedings |
subjects | Arrays Diagonal/Anti-diagonal Parity Encoding Equations Horizontal Parity Layout Load Balancing Load management Mathematical model MDS Code Performance Evaluation RAID-6 Reliability |
title | HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6 |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T00%3A10%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=HDP%20code:%20A%20Horizontal-Diagonal%20Parity%20Code%20to%20Optimize%20I/O%20load%20balancing%20in%20RAID-6&rft.btitle=2011%20IEEE/IFIP%2041st%20International%20Conference%20on%20Dependable%20Systems%20&%20Networks%20(DSN)&rft.au=Chentao%20Wu&rft.date=2011-06&rft.spage=209&rft.epage=220&rft.pages=209-220&rft.issn=1530-0889&rft.eissn=2158-3927&rft.isbn=9781424492329&rft.isbn_list=1424492327&rft_id=info:doi/10.1109/DSN.2011.5958220&rft_dat=%3Cieee_6IE%3E5958220%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9781424492336&rft.eisbn_list=1424492319&rft.eisbn_list=9781424492312&rft.eisbn_list=1424492335&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=5958220&rfr_iscdi=true |