Customizing the swarm storage system using agents

Swarm is a scalable, modular storage system that uses agents to customize low‐level storage functions to meet the needs of high‐level services. Agents influence low‐level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Software, practice & experience practice & experience, 2006-02, Vol.36 (2), p.117-137
Hauptverfasser: Hartman, John H., Baker, Scott, Murdock, Ian
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 137
container_issue 2
container_start_page 117
container_title Software, practice & experience
container_volume 36
creator Hartman, John H.
Baker, Scott
Murdock, Ian
description Swarm is a scalable, modular storage system that uses agents to customize low‐level storage functions to meet the needs of high‐level services. Agents influence low‐level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so. Copyright © 2005 John Wiley & Sons, Ltd.
doi_str_mv 10.1002/spe.685
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_29197683</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>29197683</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2925-be68e0d427d7efd0ca0cd4d6eec807b075badefc52f26114ff67546ceaad8a7c3</originalsourceid><addsrcrecordid>eNp10E1Lw0AQBuBFFKxV_As56UFSZzf7kRyltFUoKqjU27LdTGo0aepuQq2_3i0Rb56GeedhDi8h5xRGFIBd-w2OZCoOyIBCpmJg_PWQDACSNAbJ-TE58f4dgFLB5IDQcefbpi6_y_Uqat8w8lvj6ihkzqzCtvMt1lHn9-cQrFt_So4KU3k8-51D8jKdPI9v4_nD7G58M48ty5iIlyhThJwzlSsscrAGbM5ziWhTUEtQYmlyLKxgBZOU8qKQSnBp0Zg8NcomQ3LR_9245rND3-q69Baryqyx6bxmGc2UTJMAL3toXeO9w0JvXFkbt9MU9L4SHSrRoZIgr3q5LSvc_cf00-Ok13Gvy9DB15827kNLlSihF_czvciEYGq20JD8ANLJcho</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>29197683</pqid></control><display><type>article</type><title>Customizing the swarm storage system using agents</title><source>Wiley Online Library Journals Frontfile Complete</source><creator>Hartman, John H. ; Baker, Scott ; Murdock, Ian</creator><creatorcontrib>Hartman, John H. ; Baker, Scott ; Murdock, Ian</creatorcontrib><description>Swarm is a scalable, modular storage system that uses agents to customize low‐level storage functions to meet the needs of high‐level services. Agents influence low‐level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so. Copyright © 2005 John Wiley &amp; Sons, Ltd.</description><identifier>ISSN: 0038-0644</identifier><identifier>EISSN: 1097-024X</identifier><identifier>DOI: 10.1002/spe.685</identifier><language>eng</language><publisher>Chichester, UK: John Wiley &amp; Sons, Ltd</publisher><subject>agents ; file system ; LFS ; log structured ; storage system</subject><ispartof>Software, practice &amp; experience, 2006-02, Vol.36 (2), p.117-137</ispartof><rights>Copyright © 2005 John Wiley &amp; Sons, Ltd.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c2925-be68e0d427d7efd0ca0cd4d6eec807b075badefc52f26114ff67546ceaad8a7c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fspe.685$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fspe.685$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,778,782,1414,27907,27908,45557,45558</link.rule.ids></links><search><creatorcontrib>Hartman, John H.</creatorcontrib><creatorcontrib>Baker, Scott</creatorcontrib><creatorcontrib>Murdock, Ian</creatorcontrib><title>Customizing the swarm storage system using agents</title><title>Software, practice &amp; experience</title><addtitle>Softw: Pract. Exper</addtitle><description>Swarm is a scalable, modular storage system that uses agents to customize low‐level storage functions to meet the needs of high‐level services. Agents influence low‐level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so. Copyright © 2005 John Wiley &amp; Sons, Ltd.</description><subject>agents</subject><subject>file system</subject><subject>LFS</subject><subject>log structured</subject><subject>storage system</subject><issn>0038-0644</issn><issn>1097-024X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2006</creationdate><recordtype>article</recordtype><recordid>eNp10E1Lw0AQBuBFFKxV_As56UFSZzf7kRyltFUoKqjU27LdTGo0aepuQq2_3i0Rb56GeedhDi8h5xRGFIBd-w2OZCoOyIBCpmJg_PWQDACSNAbJ-TE58f4dgFLB5IDQcefbpi6_y_Uqat8w8lvj6ihkzqzCtvMt1lHn9-cQrFt_So4KU3k8-51D8jKdPI9v4_nD7G58M48ty5iIlyhThJwzlSsscrAGbM5ziWhTUEtQYmlyLKxgBZOU8qKQSnBp0Zg8NcomQ3LR_9245rND3-q69Baryqyx6bxmGc2UTJMAL3toXeO9w0JvXFkbt9MU9L4SHSrRoZIgr3q5LSvc_cf00-Ok13Gvy9DB15827kNLlSihF_czvciEYGq20JD8ANLJcho</recordid><startdate>200602</startdate><enddate>200602</enddate><creator>Hartman, John H.</creator><creator>Baker, Scott</creator><creator>Murdock, Ian</creator><general>John Wiley &amp; Sons, Ltd</general><scope>BSCLL</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>200602</creationdate><title>Customizing the swarm storage system using agents</title><author>Hartman, John H. ; Baker, Scott ; Murdock, Ian</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2925-be68e0d427d7efd0ca0cd4d6eec807b075badefc52f26114ff67546ceaad8a7c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2006</creationdate><topic>agents</topic><topic>file system</topic><topic>LFS</topic><topic>log structured</topic><topic>storage system</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hartman, John H.</creatorcontrib><creatorcontrib>Baker, Scott</creatorcontrib><creatorcontrib>Murdock, Ian</creatorcontrib><collection>Istex</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Software, practice &amp; experience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hartman, John H.</au><au>Baker, Scott</au><au>Murdock, Ian</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Customizing the swarm storage system using agents</atitle><jtitle>Software, practice &amp; experience</jtitle><addtitle>Softw: Pract. Exper</addtitle><date>2006-02</date><risdate>2006</risdate><volume>36</volume><issue>2</issue><spage>117</spage><epage>137</epage><pages>117-137</pages><issn>0038-0644</issn><eissn>1097-024X</eissn><abstract>Swarm is a scalable, modular storage system that uses agents to customize low‐level storage functions to meet the needs of high‐level services. Agents influence low‐level storage functions such as data layout, metadata management, and crash recovery. An agent is a program that is attached to data in the storage system and invoked when events occur during the data's lifetime. For example, before Swarm writes data to disk, agents attached to the data are invoked to determine a layout policy. Agents are typically persistent, remaining attached to the data they manage until the data are deleted; this allows agents to continue to affect how the data are handled long after the application or storage service that created the data has terminated. In this paper, we present Swarm's agent architecture, describe the types of agents that Swarm supports and the infrastructure used to support them, and discuss their performance overhead and security implications. We describe how several storage services and applications use agents, and the benefits they derive from doing so. Copyright © 2005 John Wiley &amp; Sons, Ltd.</abstract><cop>Chichester, UK</cop><pub>John Wiley &amp; Sons, Ltd</pub><doi>10.1002/spe.685</doi><tpages>21</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0038-0644
ispartof Software, practice & experience, 2006-02, Vol.36 (2), p.117-137
issn 0038-0644
1097-024X
language eng
recordid cdi_proquest_miscellaneous_29197683
source Wiley Online Library Journals Frontfile Complete
subjects agents
file system
LFS
log structured
storage system
title Customizing the swarm storage system using agents
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T17%3A58%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Customizing%20the%20swarm%20storage%20system%20using%20agents&rft.jtitle=Software,%20practice%20&%20experience&rft.au=Hartman,%20John%20H.&rft.date=2006-02&rft.volume=36&rft.issue=2&rft.spage=117&rft.epage=137&rft.pages=117-137&rft.issn=0038-0644&rft.eissn=1097-024X&rft_id=info:doi/10.1002/spe.685&rft_dat=%3Cproquest_cross%3E29197683%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=29197683&rft_id=info:pmid/&rfr_iscdi=true