HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6

With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes i...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chentao Wu, Xubin He, Guanying Wu, Shenggang Wan, Xiaohua Liu, Qiang Cao, Changsheng Xie
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 220
container_issue
container_start_page 209
container_title
container_volume
creator Chentao Wu
Xubin He
Guanying Wu
Shenggang Wan
Xiaohua Liu
Qiang Cao
Changsheng Xie
description With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.
doi_str_mv 10.1109/DSN.2011.5958220
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_5958220</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5958220</ieee_id><sourcerecordid>5958220</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-f16f7380a13d2a00b2808a80329c7e0e51c08c3b76ac809fb93ee316910937e83</originalsourceid><addsrcrecordid>eNpVkE9rwkAUxLf_oGK9F3rZL7D63q7ZfdubGFsFqdLas7zEjWyJicRc9NM3UC-dyxxmGIafEM8IQ0Two_TrY6gBcZj4hLSGGzHwjnCsx2OvjbG3oqcxIWW8dnf_Mu3vRQ8TAwqI_KMYnE4_0MlaD5Z6YjNP1zKvd-FVTuS8buKlrlouVRp5X1dcyjU3sT3LaVeRbS1XxzYe4iXIxWgly5p3MuOSqzxWexkr-TlZpMo-iYeCy1MYXL0vvt9mm-lcLVfvi-lkqSK6pFUF2sIZAkaz0wyQaQJigu507gKEBHOg3GTOck7gi8ybEAxa3yExLpDpi5e_3RhC2B6beODmvL0yMr_ERVIo</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</creator><creatorcontrib>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</creatorcontrib><description>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</description><identifier>ISSN: 1530-0889</identifier><identifier>ISBN: 9781424492329</identifier><identifier>ISBN: 1424492327</identifier><identifier>EISSN: 2158-3927</identifier><identifier>EISBN: 9781424492336</identifier><identifier>EISBN: 1424492319</identifier><identifier>EISBN: 9781424492312</identifier><identifier>EISBN: 1424492335</identifier><identifier>DOI: 10.1109/DSN.2011.5958220</identifier><language>eng</language><publisher>IEEE</publisher><subject>Arrays ; Diagonal/Anti-diagonal Parity ; Encoding ; Equations ; Horizontal Parity ; Layout ; Load Balancing ; Load management ; Mathematical model ; MDS Code ; Performance Evaluation ; RAID-6 ; Reliability</subject><ispartof>2011 IEEE/IFIP 41st International Conference on Dependable Systems &amp; Networks (DSN), 2011, p.209-220</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5958220$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5958220$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Chentao Wu</creatorcontrib><creatorcontrib>Xubin He</creatorcontrib><creatorcontrib>Guanying Wu</creatorcontrib><creatorcontrib>Shenggang Wan</creatorcontrib><creatorcontrib>Xiaohua Liu</creatorcontrib><creatorcontrib>Qiang Cao</creatorcontrib><creatorcontrib>Changsheng Xie</creatorcontrib><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><title>2011 IEEE/IFIP 41st International Conference on Dependable Systems &amp; Networks (DSN)</title><addtitle>DSN</addtitle><description>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</description><subject>Arrays</subject><subject>Diagonal/Anti-diagonal Parity</subject><subject>Encoding</subject><subject>Equations</subject><subject>Horizontal Parity</subject><subject>Layout</subject><subject>Load Balancing</subject><subject>Load management</subject><subject>Mathematical model</subject><subject>MDS Code</subject><subject>Performance Evaluation</subject><subject>RAID-6</subject><subject>Reliability</subject><issn>1530-0889</issn><issn>2158-3927</issn><isbn>9781424492329</isbn><isbn>1424492327</isbn><isbn>9781424492336</isbn><isbn>1424492319</isbn><isbn>9781424492312</isbn><isbn>1424492335</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2011</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpVkE9rwkAUxLf_oGK9F3rZL7D63q7ZfdubGFsFqdLas7zEjWyJicRc9NM3UC-dyxxmGIafEM8IQ0Two_TrY6gBcZj4hLSGGzHwjnCsx2OvjbG3oqcxIWW8dnf_Mu3vRQ8TAwqI_KMYnE4_0MlaD5Z6YjNP1zKvd-FVTuS8buKlrlouVRp5X1dcyjU3sT3LaVeRbS1XxzYe4iXIxWgly5p3MuOSqzxWexkr-TlZpMo-iYeCy1MYXL0vvt9mm-lcLVfvi-lkqSK6pFUF2sIZAkaz0wyQaQJigu507gKEBHOg3GTOck7gi8ybEAxa3yExLpDpi5e_3RhC2B6beODmvL0yMr_ERVIo</recordid><startdate>201106</startdate><enddate>201106</enddate><creator>Chentao Wu</creator><creator>Xubin He</creator><creator>Guanying Wu</creator><creator>Shenggang Wan</creator><creator>Xiaohua Liu</creator><creator>Qiang Cao</creator><creator>Changsheng Xie</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>201106</creationdate><title>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</title><author>Chentao Wu ; Xubin He ; Guanying Wu ; Shenggang Wan ; Xiaohua Liu ; Qiang Cao ; Changsheng Xie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-f16f7380a13d2a00b2808a80329c7e0e51c08c3b76ac809fb93ee316910937e83</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2011</creationdate><topic>Arrays</topic><topic>Diagonal/Anti-diagonal Parity</topic><topic>Encoding</topic><topic>Equations</topic><topic>Horizontal Parity</topic><topic>Layout</topic><topic>Load Balancing</topic><topic>Load management</topic><topic>Mathematical model</topic><topic>MDS Code</topic><topic>Performance Evaluation</topic><topic>RAID-6</topic><topic>Reliability</topic><toplevel>online_resources</toplevel><creatorcontrib>Chentao Wu</creatorcontrib><creatorcontrib>Xubin He</creatorcontrib><creatorcontrib>Guanying Wu</creatorcontrib><creatorcontrib>Shenggang Wan</creatorcontrib><creatorcontrib>Xiaohua Liu</creatorcontrib><creatorcontrib>Qiang Cao</creatorcontrib><creatorcontrib>Changsheng Xie</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chentao Wu</au><au>Xubin He</au><au>Guanying Wu</au><au>Shenggang Wan</au><au>Xiaohua Liu</au><au>Qiang Cao</au><au>Changsheng Xie</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6</atitle><btitle>2011 IEEE/IFIP 41st International Conference on Dependable Systems &amp; Networks (DSN)</btitle><stitle>DSN</stitle><date>2011-06</date><risdate>2011</risdate><spage>209</spage><epage>220</epage><pages>209-220</pages><issn>1530-0889</issn><eissn>2158-3927</eissn><isbn>9781424492329</isbn><isbn>1424492327</isbn><eisbn>9781424492336</eisbn><eisbn>1424492319</eisbn><eisbn>9781424492312</eisbn><eisbn>1424492335</eisbn><abstract>With higher reliability requirements in clusters and data centers, RAID-6 has gained popularity due to its capability to tolerate concurrent failures of any two disks, which has been shown to be of increasing importance in large scale storage systems. Among various implementations of erasure codes in RAID-6, a typical set of codes known as Maximum Distance Separable (MDS) codes aim to offer data protection against disk failures with optimal storage efficiency. However, because of the limitation of horizontal parity or diagonal/anti-diagonal parities used in MDS codes, storage systems based on RAID-6 suffers from unbalanced I/O and thus low performance and reliability. To address this issue, in this paper, we propose a new parity called Horizontal-Diagonal Parity (HDP), which takes advantages of both horizontal and diagonal/anti-diagonal parities. The corresponding MDS code, called HDP code, distributes parity elements uniformly in each disk to balance the I/O workloads. HDP also achieves high reliability via speeding up the recovery under single or double disk failure. Our analysis shows that HDP provides better balanced I/O and higher reliability compared to other popular MDS codes.</abstract><pub>IEEE</pub><doi>10.1109/DSN.2011.5958220</doi><tpages>12</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1530-0889
ispartof 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN), 2011, p.209-220
issn 1530-0889
2158-3927
language eng
recordid cdi_ieee_primary_5958220
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Arrays
Diagonal/Anti-diagonal Parity
Encoding
Equations
Horizontal Parity
Layout
Load Balancing
Load management
Mathematical model
MDS Code
Performance Evaluation
RAID-6
Reliability
title HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O load balancing in RAID-6
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T00%3A10%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=HDP%20code:%20A%20Horizontal-Diagonal%20Parity%20Code%20to%20Optimize%20I/O%20load%20balancing%20in%20RAID-6&rft.btitle=2011%20IEEE/IFIP%2041st%20International%20Conference%20on%20Dependable%20Systems%20&%20Networks%20(DSN)&rft.au=Chentao%20Wu&rft.date=2011-06&rft.spage=209&rft.epage=220&rft.pages=209-220&rft.issn=1530-0889&rft.eissn=2158-3927&rft.isbn=9781424492329&rft.isbn_list=1424492327&rft_id=info:doi/10.1109/DSN.2011.5958220&rft_dat=%3Cieee_6IE%3E5958220%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9781424492336&rft.eisbn_list=1424492319&rft.eisbn_list=9781424492312&rft.eisbn_list=1424492335&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=5958220&rfr_iscdi=true