Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems
This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a schedul...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on computers 2018-04, Vol.67 (4), p.573-581 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 581 |
---|---|
container_issue | 4 |
container_start_page | 573 |
container_title | IEEE transactions on computers |
container_volume | 67 |
creator | Shen, Jiajie Zhang, Kai Gu, Jiazhen Zhou, Yangfan Wang, Xin |
description | This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches. |
doi_str_mv | 10.1109/TC.2017.2769051 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2174501829</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8094270</ieee_id><sourcerecordid>2174501829</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</originalsourceid><addsrcrecordid>eNo9kD1PwzAURS0EEqUwM7BYYk76bCdOPNKofEhFDE1ny3WeS0qaFDsZ-u9J1Yrp3eHc-6RDyCODmDFQs7KIObAs5plUkLIrMmFpmkVKpfKaTABYHimRwC25C2EHAJKDmpBy4Vxta2x7urLfWA1N3W6p6zz9HJq-juZNZ3_o-lCZHgOtW7rwJgweadFVJ3JuAlZ01XfebJGujqHHfbgnN840AR8ud0rWr4uyeI-WX28fxcsysjxXfWQzwMpxKYy0Y-JSIjOGp5lQzijFNnKTylzAJne5cCJJuDUVCp4Cg4ojiCl5Pu8efPc7YOj1rht8O77UnGXJyOVcjdTsTFnfheDR6YOv98YfNQN9UqfLQp_U6Yu6sfF0btSI-E_noBKegfgD2mhpFQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2174501829</pqid></control><display><type>article</type><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><source>IEEE Electronic Library (IEL)</source><creator>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</creator><creatorcontrib>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</creatorcontrib><description>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</description><identifier>ISSN: 0018-9340</identifier><identifier>EISSN: 1557-9956</identifier><identifier>DOI: 10.1109/TC.2017.2769051</identifier><identifier>CODEN: ITCOB4</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithm design and analysis ; Algorithms ; Binary system ; Cloud computing ; Coding ; data updates ; disk array ; disk I/O overhead ; Encoding ; Erasure codes ; Hierarchies ; Input output analysis ; Prototypes ; Reliability ; Schedules ; Scheduling ; Scheduling algorithms ; State of the art ; Storage systems ; Systems integration</subject><ispartof>IEEE transactions on computers, 2018-04, Vol.67 (4), p.573-581</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2018</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</citedby><cites>FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</cites><orcidid>0000-0002-6479-5063</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8094270$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8094270$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Shen, Jiajie</creatorcontrib><creatorcontrib>Zhang, Kai</creatorcontrib><creatorcontrib>Gu, Jiazhen</creatorcontrib><creatorcontrib>Zhou, Yangfan</creatorcontrib><creatorcontrib>Wang, Xin</creatorcontrib><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><title>IEEE transactions on computers</title><addtitle>TC</addtitle><description>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</description><subject>Algorithm design and analysis</subject><subject>Algorithms</subject><subject>Binary system</subject><subject>Cloud computing</subject><subject>Coding</subject><subject>data updates</subject><subject>disk array</subject><subject>disk I/O overhead</subject><subject>Encoding</subject><subject>Erasure codes</subject><subject>Hierarchies</subject><subject>Input output analysis</subject><subject>Prototypes</subject><subject>Reliability</subject><subject>Schedules</subject><subject>Scheduling</subject><subject>Scheduling algorithms</subject><subject>State of the art</subject><subject>Storage systems</subject><subject>Systems integration</subject><issn>0018-9340</issn><issn>1557-9956</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kD1PwzAURS0EEqUwM7BYYk76bCdOPNKofEhFDE1ny3WeS0qaFDsZ-u9J1Yrp3eHc-6RDyCODmDFQs7KIObAs5plUkLIrMmFpmkVKpfKaTABYHimRwC25C2EHAJKDmpBy4Vxta2x7urLfWA1N3W6p6zz9HJq-juZNZ3_o-lCZHgOtW7rwJgweadFVJ3JuAlZ01XfebJGujqHHfbgnN840AR8ud0rWr4uyeI-WX28fxcsysjxXfWQzwMpxKYy0Y-JSIjOGp5lQzijFNnKTylzAJne5cCJJuDUVCp4Cg4ojiCl5Pu8efPc7YOj1rht8O77UnGXJyOVcjdTsTFnfheDR6YOv98YfNQN9UqfLQp_U6Yu6sfF0btSI-E_noBKegfgD2mhpFQ</recordid><startdate>20180401</startdate><enddate>20180401</enddate><creator>Shen, Jiajie</creator><creator>Zhang, Kai</creator><creator>Gu, Jiazhen</creator><creator>Zhou, Yangfan</creator><creator>Wang, Xin</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-6479-5063</orcidid></search><sort><creationdate>20180401</creationdate><title>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</title><author>Shen, Jiajie ; Zhang, Kai ; Gu, Jiazhen ; Zhou, Yangfan ; Wang, Xin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-c70edf263a6c0ed266e1aa25739fa991b6b56830b8f83f3442cade325010d2e03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithm design and analysis</topic><topic>Algorithms</topic><topic>Binary system</topic><topic>Cloud computing</topic><topic>Coding</topic><topic>data updates</topic><topic>disk array</topic><topic>disk I/O overhead</topic><topic>Encoding</topic><topic>Erasure codes</topic><topic>Hierarchies</topic><topic>Input output analysis</topic><topic>Prototypes</topic><topic>Reliability</topic><topic>Schedules</topic><topic>Scheduling</topic><topic>Scheduling algorithms</topic><topic>State of the art</topic><topic>Storage systems</topic><topic>Systems integration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Shen, Jiajie</creatorcontrib><creatorcontrib>Zhang, Kai</creatorcontrib><creatorcontrib>Gu, Jiazhen</creatorcontrib><creatorcontrib>Zhou, Yangfan</creatorcontrib><creatorcontrib>Wang, Xin</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on computers</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Shen, Jiajie</au><au>Zhang, Kai</au><au>Gu, Jiazhen</au><au>Zhou, Yangfan</au><au>Wang, Xin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems</atitle><jtitle>IEEE transactions on computers</jtitle><stitle>TC</stitle><date>2018-04-01</date><risdate>2018</risdate><volume>67</volume><issue>4</issue><spage>573</spage><epage>581</epage><pages>573-581</pages><issn>0018-9340</issn><eissn>1557-9956</eissn><coden>ITCOB4</coden><abstract>This paper considers the problem of how to reduce the I/O overhead of data update operations in erasure coding based storage systems. To this end, we first analyze the I/O overhead of update operations with current update approaches. We find the key to reduce such I/O overhead is designing a scheduling algorithm to construct the sequence of update operations. Such an algorithm needs to execute with a time limit, since update requests work under a stringent latency constraint. To quickly schedule the order of update operations, we propose an efficient algorithm, namely UCODR. Our theoretical analysis verifies that UCODR can effectively reduce the I/O overhead of update operations when multiple blocks are updated. To further confirm its effectiveness, we implement a prototype storage system to deploy UCODR with different erasure codes. Extensive experiments are conducted on the prototype storage system with real-world traces. The experimental results show that UCODR can reduce the time of update operations by up to 35 percent and improve the throughput of the storage system by up to 67 percent, compared with the state-of-the-art update approaches.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TC.2017.2769051</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-6479-5063</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0018-9340 |
ispartof | IEEE transactions on computers, 2018-04, Vol.67 (4), p.573-581 |
issn | 0018-9340 1557-9956 |
language | eng |
recordid | cdi_proquest_journals_2174501829 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithm design and analysis Algorithms Binary system Cloud computing Coding data updates disk array disk I/O overhead Encoding Erasure codes Hierarchies Input output analysis Prototypes Reliability Schedules Scheduling Scheduling algorithms State of the art Storage systems Systems integration |
title | Efficient Scheduling for Multi-Block Updates in Erasure Coding Based Storage Systems |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T21%3A41%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Efficient%20Scheduling%20for%20Multi-Block%20Updates%20in%20Erasure%20Coding%20Based%20Storage%20Systems&rft.jtitle=IEEE%20transactions%20on%20computers&rft.au=Shen,%20Jiajie&rft.date=2018-04-01&rft.volume=67&rft.issue=4&rft.spage=573&rft.epage=581&rft.pages=573-581&rft.issn=0018-9340&rft.eissn=1557-9956&rft.coden=ITCOB4&rft_id=info:doi/10.1109/TC.2017.2769051&rft_dat=%3Cproquest_RIE%3E2174501829%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2174501829&rft_id=info:pmid/&rft_ieee_id=8094270&rfr_iscdi=true |