Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems

This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a schedul...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on computers 2018-04, Vol.67 (4), p.573-581
Hauptverfasser: Shen, Jiajie, Zhang, Kai, Gu, Jiazhen, Zhou, Yangfan, Wang, Xin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 581
container_issue 4
container_start_page 573
container_title IEEE transactions on computers
container_volume 67
creator Shen, Jiajie
Zhang, Kai
Gu, Jiazhen
Zhou, Yangfan
Wang, Xin
description This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.
doi_str_mv 10.1109/TC.2017.2769051
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2174501829</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8094270</ieee_id><sourcerecordid>2174501829</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</originalsourceid><addsrcrecordid>eNo9kD1PwzAURS0EEqUwM7BYYk76bCdOPNKofEhFDE1ny3WeS0qaFDsZ-u9J1Yrp3eHc-6RDyCODmDFQs7KIObAs5plUkLIrMmFpmkVKpfKaTABYHimRwC25C2EHAJKDmpBy4Vxta2x7urLfWA1N3W6p6zz9HJq-juZNZ3_o-lCZHgOtW7rwJgweadFVJ3JuAlZ01XfebJGujqHHfbgnN840AR8ud0rWr4uyeI-WX28fxcsysjxXfWQzwMpxKYy0Y-JSIjOGp5lQzijFNnKTylzAJne5cCJJuDUVCp4Cg4ojiCl5Pu8efPc7YOj1rht8O77UnGXJyOVcjdTsTFnfheDR6YOv98YfNQN9UqfLQp_U6Yu6sfF0btSI-E_noBKegfgD2mhpFQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2174501829</pqid></control><display><type>article</type><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><source>IEEE Electronic Library (IEL)</source><creator>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</creator><creatorcontrib>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</creatorcontrib><description>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</description><identifier>ISSN: 0018-9340</identifier><identifier>EISSN: 1557-9956</identifier><identifier>DOI: 10.1109/TC.2017.2769051</identifier><identifier>CODEN: ITCOB4</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithm design and analysis ; Algorithms ; Binary system ; Cloud computing ; Coding ; data updates ; disk array ; disk I/O overhead ; Encoding ; Erasure codes ; Hierarchies ; Input output analysis ; Prototypes ; Reliability ; Schedules ; Scheduling ; Scheduling algorithms ; State of the art ; Storage systems ; Systems integration</subject><ispartof>IEEE transactions on computers, 2018-04, Vol.67 (4), p.573-581</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2018</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</citedby><cites>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</cites><orcidid>0000-0002-6479-5063</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8094270$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8094270$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Shen, Jiajie</creatorcontrib><creatorcontrib>Zhang, Kai</creatorcontrib><creatorcontrib>Gu, Jiazhen</creatorcontrib><creatorcontrib>Zhou, Yangfan</creatorcontrib><creatorcontrib>Wang, Xin</creatorcontrib><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><title>IEEE transactions on computers</title><addtitle>TC</addtitle><description>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</description><subject>Algorithm design and analysis</subject><subject>Algorithms</subject><subject>Binary system</subject><subject>Cloud computing</subject><subject>Coding</subject><subject>data updates</subject><subject>disk array</subject><subject>disk I/O overhead</subject><subject>Encoding</subject><subject>Erasure codes</subject><subject>Hierarchies</subject><subject>Input output analysis</subject><subject>Prototypes</subject><subject>Reliability</subject><subject>Schedules</subject><subject>Scheduling</subject><subject>Scheduling algorithms</subject><subject>State of the art</subject><subject>Storage systems</subject><subject>Systems integration</subject><issn>0018-9340</issn><issn>1557-9956</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kD1PwzAURS0EEqUwM7BYYk76bCdOPNKofEhFDE1ny3WeS0qaFDsZ-u9J1Yrp3eHc-6RDyCODmDFQs7KIObAs5plUkLIrMmFpmkVKpfKaTABYHimRwC25C2EHAJKDmpBy4Vxta2x7urLfWA1N3W6p6zz9HJq-juZNZ3_o-lCZHgOtW7rwJgweadFVJ3JuAlZ01XfebJGujqHHfbgnN840AR8ud0rWr4uyeI-WX28fxcsysjxXfWQzwMpxKYy0Y-JSIjOGp5lQzijFNnKTylzAJne5cCJJuDUVCp4Cg4ojiCl5Pu8efPc7YOj1rht8O77UnGXJyOVcjdTsTFnfheDR6YOv98YfNQN9UqfLQp_U6Yu6sfF0btSI-E_noBKegfgD2mhpFQ</recordid><startdate>20180401</startdate><enddate>20180401</enddate><creator>Shen, Jiajie</creator><creator>Zhang, Kai</creator><creator>Gu, Jiazhen</creator><creator>Zhou, Yangfan</creator><creator>Wang, Xin</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-6479-5063</orcidid></search><sort><creationdate>20180401</creationdate><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><author>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithm design and analysis</topic><topic>Algorithms</topic><topic>Binary system</topic><topic>Cloud computing</topic><topic>Coding</topic><topic>data updates</topic><topic>disk array</topic><topic>disk I/O overhead</topic><topic>Encoding</topic><topic>Erasure codes</topic><topic>Hierarchies</topic><topic>Input output analysis</topic><topic>Prototypes</topic><topic>Reliability</topic><topic>Schedules</topic><topic>Scheduling</topic><topic>Scheduling algorithms</topic><topic>State of the art</topic><topic>Storage systems</topic><topic>Systems integration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Shen, Jiajie</creatorcontrib><creatorcontrib>Zhang, Kai</creatorcontrib><creatorcontrib>Gu, Jiazhen</creatorcontrib><creatorcontrib>Zhou, Yangfan</creatorcontrib><creatorcontrib>Wang, Xin</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on computers</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Shen, Jiajie</au><au>Zhang, Kai</au><au>Gu, Jiazhen</au><au>Zhou, Yangfan</au><au>Wang, Xin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</atitle><jtitle>IEEE transactions on computers</jtitle><stitle>TC</stitle><date>2018-04-01</date><risdate>2018</risdate><volume>67</volume><issue>4</issue><spage>573</spage><epage>581</epage><pages>573-581</pages><issn>0018-9340</issn><eissn>1557-9956</eissn><coden>ITCOB4</coden><abstract>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TC.2017.2769051</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-6479-5063</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9340
ispartof IEEE transactions on computers, 2018-04, Vol.67 (4), p.573-581
issn 0018-9340
1557-9956
language eng
recordid cdi_proquest_journals_2174501829
source IEEE Electronic Library (IEL)
subjects Algorithm design and analysis
Algorithms
Binary system
Cloud computing
Coding
data updates
disk array
disk I/O overhead
Encoding
Erasure codes
Hierarchies
Input output analysis
Prototypes
Reliability
Schedules
Scheduling
Scheduling algorithms
State of the art
Storage systems
Systems integration
title Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T21%3A41%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Efficient%20Scheduling%20for%20Multi-Block%20Updates%20in%20Erasure%20Coding%20Based%20Storage%20Systems&rft.jtitle=IEEE%20transactions%20on%20computers&rft.au=Shen,%20Jiajie&rft.date=2018-04-01&rft.volume=67&rft.issue=4&rft.spage=573&rft.epage=581&rft.pages=573-581&rft.issn=0018-9340&rft.eissn=1557-9956&rft.coden=ITCOB4&rft_id=info:doi/10.1109/TC.2017.2769051&rft_dat=%3Cproquest_RIE%3E2174501829%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2174501829&rft_id=info:pmid/&rft_ieee_id=8094270&rfr_iscdi=true