Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields

A novel technique for construction of minimum storage regenerating (MSR) codes is presented. Based on this technique, three explicit constructions of MSR codes are given. The first two constructions provide access-optimal MSR codes, with two and three parities, respectively, which attain the sub-pac...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on information theory 2017-04, Vol.63 (4), p.2015-2038
Hauptverfasser: Raviv, Netanel, Silberstein, Natalia, Etzion, Tuvi
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2038
container_issue 4
container_start_page 2015
container_title IEEE transactions on information theory
container_volume 63
creator Raviv, Netanel
Silberstein, Natalia
Etzion, Tuvi
description A novel technique for construction of minimum storage regenerating (MSR) codes is presented. Based on this technique, three explicit constructions of MSR codes are given. The first two constructions provide access-optimal MSR codes, with two and three parities, respectively, which attain the sub-packetization bound for access-optimal codes. The third construction provides longer MSR codes with three parities (i.e., codes with larger number of systematic nodes). This improvement is achieved at the expense of the access-optimality and the field size. In addition to a minimum storage in a node, all three constructions allow the entire data to be recovered from a minimal number of storage nodes. That is, given storage ℓ in each node, the entire stored data can be recovered from any 2 log 2 ℓ for two parity nodes, and either 3 log 3 ℓ or 4 log 3 ℓ for three parities. Second, in the first two constructions, a helper node accesses the minimum number of its symbols for repair of a failed node (access-optimality). The goal of this paper is to provide a construction of such optimal codes over the smallest possible finite fields. The generator matrix of these codes is based on perfect matchings of complete graphs and hypergraphs, and on a rational canonical form of matrices. For two parities, the field size is reduced by a factor of two for access-optimal codes compared to previous constructions. For three parities, in the first construction a field size of at least 6 log 3 ℓ +1 (or 3 log 3 ℓ +1 for fields with characteristic 2) is sufficient, and in the second construction the field size is larger, yet linear in log 3 ℓ. Both constructions with three parities provide a significant improvement over previous works due to either decreased field size or lower subpacketization.
doi_str_mv 10.1109/TIT.2017.2658660
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIT_2017_2658660</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7833084</ieee_id><sourcerecordid>2174326293</sourcerecordid><originalsourceid>FETCH-LOGICAL-c291t-4898aac3e80c6fb7a105d595f02c544e700b52163616bd5d347250333c90edae3</originalsourceid><addsrcrecordid>eNo9kE1Lw0AQhhdRsFbvgpcFz6n7nd2jBGsLlUJbz8s2mcQt-ai7ieC_N6XF07wDzzsDD0KPlMwoJeZlt9zNGKHpjCmplSJXaEKlTBOjpLhGE0KoTowQ-hbdxXgYVyEpm6B11rWxD0Pe-zHgrsQLX30lG9cD_vCtb4YGb_suuArwBipoIbjetxXOugIiXv9AwNvG1TWee6iLeI9uSldHeLjMKfqcv-2yRbJavy-z11WSM0P7RGijncs5aJKrcp86SmQhjSwJy6UQkBKyl4wqrqjaF7LgImWScM5zQ6BwwKfo-Xz3GLrvAWJvD90Q2vGlZTQVnClm-EiRM5WHLsYApT0G37jwaymxJ2121GZP2uxF21h5Olc8APzjqeacaMH_ADFyZ4s</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2174326293</pqid></control><display><type>article</type><title>Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields</title><source>IEEE Electronic Library (IEL)</source><creator>Raviv, Netanel ; Silberstein, Natalia ; Etzion, Tuvi</creator><creatorcontrib>Raviv, Netanel ; Silberstein, Natalia ; Etzion, Tuvi</creatorcontrib><description>A novel technique for construction of minimum storage regenerating (MSR) codes is presented. Based on this technique, three explicit constructions of MSR codes are given. The first two constructions provide access-optimal MSR codes, with two and three parities, respectively, which attain the sub-packetization bound for access-optimal codes. The third construction provides longer MSR codes with three parities (i.e., codes with larger number of systematic nodes). This improvement is achieved at the expense of the access-optimality and the field size. In addition to a minimum storage in a node, all three constructions allow the entire data to be recovered from a minimal number of storage nodes. That is, given storage ℓ in each node, the entire stored data can be recovered from any 2 log 2 ℓ for two parity nodes, and either 3 log 3 ℓ or 4 log 3 ℓ for three parities. Second, in the first two constructions, a helper node accesses the minimum number of its symbols for repair of a failed node (access-optimality). The goal of this paper is to provide a construction of such optimal codes over the smallest possible finite fields. The generator matrix of these codes is based on perfect matchings of complete graphs and hypergraphs, and on a rational canonical form of matrices. For two parities, the field size is reduced by a factor of two for access-optimal codes compared to previous constructions. For three parities, in the first construction a field size of at least 6 log 3 ℓ +1 (or 3 log 3 ℓ +1 for fields with characteristic 2) is sufficient, and in the second construction the field size is larger, yet linear in log 3 ℓ. Both constructions with three parities provide a significant improvement over previous works due to either decreased field size or lower subpacketization.</description><identifier>ISSN: 0018-9448</identifier><identifier>EISSN: 1557-9654</identifier><identifier>DOI: 10.1109/TIT.2017.2658660</identifier><identifier>CODEN: IETTAW</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>access-optimal codes ; Bandwidth ; Codes ; Decision support systems ; Distributed databases ; Eigenvalues and eigenfunctions ; Fields (mathematics) ; Maintenance engineering ; Matrix converters ; MSR codes ; Nodes ; Optimization ; perfect matchings ; Regenerating codes ; subspace condition ; Systematics</subject><ispartof>IEEE transactions on information theory, 2017-04, Vol.63 (4), p.2015-2038</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2017</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c291t-4898aac3e80c6fb7a105d595f02c544e700b52163616bd5d347250333c90edae3</citedby><cites>FETCH-LOGICAL-c291t-4898aac3e80c6fb7a105d595f02c544e700b52163616bd5d347250333c90edae3</cites><orcidid>0000-0002-1686-1994</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7833084$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7833084$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Raviv, Netanel</creatorcontrib><creatorcontrib>Silberstein, Natalia</creatorcontrib><creatorcontrib>Etzion, Tuvi</creatorcontrib><title>Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields</title><title>IEEE transactions on information theory</title><addtitle>TIT</addtitle><description>A novel technique for construction of minimum storage regenerating (MSR) codes is presented. Based on this technique, three explicit constructions of MSR codes are given. The first two constructions provide access-optimal MSR codes, with two and three parities, respectively, which attain the sub-packetization bound for access-optimal codes. The third construction provides longer MSR codes with three parities (i.e., codes with larger number of systematic nodes). This improvement is achieved at the expense of the access-optimality and the field size. In addition to a minimum storage in a node, all three constructions allow the entire data to be recovered from a minimal number of storage nodes. That is, given storage ℓ in each node, the entire stored data can be recovered from any 2 log 2 ℓ for two parity nodes, and either 3 log 3 ℓ or 4 log 3 ℓ for three parities. Second, in the first two constructions, a helper node accesses the minimum number of its symbols for repair of a failed node (access-optimality). The goal of this paper is to provide a construction of such optimal codes over the smallest possible finite fields. The generator matrix of these codes is based on perfect matchings of complete graphs and hypergraphs, and on a rational canonical form of matrices. For two parities, the field size is reduced by a factor of two for access-optimal codes compared to previous constructions. For three parities, in the first construction a field size of at least 6 log 3 ℓ +1 (or 3 log 3 ℓ +1 for fields with characteristic 2) is sufficient, and in the second construction the field size is larger, yet linear in log 3 ℓ. Both constructions with three parities provide a significant improvement over previous works due to either decreased field size or lower subpacketization.</description><subject>access-optimal codes</subject><subject>Bandwidth</subject><subject>Codes</subject><subject>Decision support systems</subject><subject>Distributed databases</subject><subject>Eigenvalues and eigenfunctions</subject><subject>Fields (mathematics)</subject><subject>Maintenance engineering</subject><subject>Matrix converters</subject><subject>MSR codes</subject><subject>Nodes</subject><subject>Optimization</subject><subject>perfect matchings</subject><subject>Regenerating codes</subject><subject>subspace condition</subject><subject>Systematics</subject><issn>0018-9448</issn><issn>1557-9654</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1Lw0AQhhdRsFbvgpcFz6n7nd2jBGsLlUJbz8s2mcQt-ai7ieC_N6XF07wDzzsDD0KPlMwoJeZlt9zNGKHpjCmplSJXaEKlTBOjpLhGE0KoTowQ-hbdxXgYVyEpm6B11rWxD0Pe-zHgrsQLX30lG9cD_vCtb4YGb_suuArwBipoIbjetxXOugIiXv9AwNvG1TWee6iLeI9uSldHeLjMKfqcv-2yRbJavy-z11WSM0P7RGijncs5aJKrcp86SmQhjSwJy6UQkBKyl4wqrqjaF7LgImWScM5zQ6BwwKfo-Xz3GLrvAWJvD90Q2vGlZTQVnClm-EiRM5WHLsYApT0G37jwaymxJ2121GZP2uxF21h5Olc8APzjqeacaMH_ADFyZ4s</recordid><startdate>20170401</startdate><enddate>20170401</enddate><creator>Raviv, Netanel</creator><creator>Silberstein, Natalia</creator><creator>Etzion, Tuvi</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-1686-1994</orcidid></search><sort><creationdate>20170401</creationdate><title>Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields</title><author>Raviv, Netanel ; Silberstein, Natalia ; Etzion, Tuvi</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c291t-4898aac3e80c6fb7a105d595f02c544e700b52163616bd5d347250333c90edae3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>access-optimal codes</topic><topic>Bandwidth</topic><topic>Codes</topic><topic>Decision support systems</topic><topic>Distributed databases</topic><topic>Eigenvalues and eigenfunctions</topic><topic>Fields (mathematics)</topic><topic>Maintenance engineering</topic><topic>Matrix converters</topic><topic>MSR codes</topic><topic>Nodes</topic><topic>Optimization</topic><topic>perfect matchings</topic><topic>Regenerating codes</topic><topic>subspace condition</topic><topic>Systematics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Raviv, Netanel</creatorcontrib><creatorcontrib>Silberstein, Natalia</creatorcontrib><creatorcontrib>Etzion, Tuvi</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on information theory</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Raviv, Netanel</au><au>Silberstein, Natalia</au><au>Etzion, Tuvi</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields</atitle><jtitle>IEEE transactions on information theory</jtitle><stitle>TIT</stitle><date>2017-04-01</date><risdate>2017</risdate><volume>63</volume><issue>4</issue><spage>2015</spage><epage>2038</epage><pages>2015-2038</pages><issn>0018-9448</issn><eissn>1557-9654</eissn><coden>IETTAW</coden><abstract>A novel technique for construction of minimum storage regenerating (MSR) codes is presented. Based on this technique, three explicit constructions of MSR codes are given. The first two constructions provide access-optimal MSR codes, with two and three parities, respectively, which attain the sub-packetization bound for access-optimal codes. The third construction provides longer MSR codes with three parities (i.e., codes with larger number of systematic nodes). This improvement is achieved at the expense of the access-optimality and the field size. In addition to a minimum storage in a node, all three constructions allow the entire data to be recovered from a minimal number of storage nodes. That is, given storage ℓ in each node, the entire stored data can be recovered from any 2 log 2 ℓ for two parity nodes, and either 3 log 3 ℓ or 4 log 3 ℓ for three parities. Second, in the first two constructions, a helper node accesses the minimum number of its symbols for repair of a failed node (access-optimality). The goal of this paper is to provide a construction of such optimal codes over the smallest possible finite fields. The generator matrix of these codes is based on perfect matchings of complete graphs and hypergraphs, and on a rational canonical form of matrices. For two parities, the field size is reduced by a factor of two for access-optimal codes compared to previous constructions. For three parities, in the first construction a field size of at least 6 log 3 ℓ +1 (or 3 log 3 ℓ +1 for fields with characteristic 2) is sufficient, and in the second construction the field size is larger, yet linear in log 3 ℓ. Both constructions with three parities provide a significant improvement over previous works due to either decreased field size or lower subpacketization.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIT.2017.2658660</doi><tpages>24</tpages><orcidid>https://orcid.org/0000-0002-1686-1994</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9448
ispartof IEEE transactions on information theory, 2017-04, Vol.63 (4), p.2015-2038
issn 0018-9448
1557-9654
language eng
recordid cdi_crossref_primary_10_1109_TIT_2017_2658660
source IEEE Electronic Library (IEL)
subjects access-optimal codes
Bandwidth
Codes
Decision support systems
Distributed databases
Eigenvalues and eigenfunctions
Fields (mathematics)
Maintenance engineering
Matrix converters
MSR codes
Nodes
Optimization
perfect matchings
Regenerating codes
subspace condition
Systematics
title Constructions of High-Rate Minimum Storage Regenerating Codes Over Small Fields
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-29T21%3A32%3A53IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Constructions%20of%20High-Rate%20Minimum%20Storage%20Regenerating%20Codes%20Over%20Small%20Fields&rft.jtitle=IEEE%20transactions%20on%20information%20theory&rft.au=Raviv,%20Netanel&rft.date=2017-04-01&rft.volume=63&rft.issue=4&rft.spage=2015&rft.epage=2038&rft.pages=2015-2038&rft.issn=0018-9448&rft.eissn=1557-9654&rft.coden=IETTAW&rft_id=info:doi/10.1109/TIT.2017.2658660&rft_dat=%3Cproquest_RIE%3E2174326293%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2174326293&rft_id=info:pmid/&rft_ieee_id=7833084&rfr_iscdi=true