PetaCache: A memory-Based Data-Server System
Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The Pe...
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Tagungsbericht |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 350 |
|---|---|
| container_issue | |
| container_start_page | 349 |
| container_title | |
| container_volume | |
| creator | Boeheim, C. Gowdy, S.J. Hanushevsky, A. Leith, D. Melen, R. Mount, R. Pulliam, T. Weeks, B. |
| description | Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The PetaCache architecture aims at a minimum unit cost, highly scalable hardware and software approach that can take advantage of existing and emerging solid-state storage technologies providing data-access latencies in the range 10-100 microseconds. A prototype system has been constructed as a cluster of 64 nodes hosting a total of one terabyte of memory. Client processors retrieve data from the data-server nodes over a switched Ethernet infrastructure using SLAC's xrootd data-server software. The system is in use for performance testing, optimization and trial deployments for scientific data analysis. It also provides an excellent platform for testing new data access paradigms |
| doi_str_mv | 10.1109/HPDC.2006.1652178 |
| format | Conference Proceeding |
| fullrecord | <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_1652178</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>1652178</ieee_id><sourcerecordid>1652178</sourcerecordid><originalsourceid>FETCH-LOGICAL-i1338-4afe70e4fb695627d4f0bb6752253d415ca2343b9b35c912a50b763e40f2585e3</originalsourceid><addsrcrecordid>eNotz8tKw0AUgOEBFWyrDyBu8gBOPJe5JO5qqrZQaKG6LjPJCUYMyiQIeXsX7erfffArdYeQI0L5uN6vqpwAXI7OEvriQs3RkDHA4PlSzRAK0kUJ_lrNh-ELgADJz9TDXsZQhfpTnrJl1kv_kyb9HAZpslUYgz5I-pOUHaZhlP5GXbXhe5Dbcxfq4_XlvVrr7e5tUy23ukPmQpvQigcxbXSldeQb00KMzlsiy41BWwdiw7GMbOsSKViI3rEYaMkWVnih7k9uJyLH39T1IU3H8xn_A8mHP2M</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>PetaCache: A memory-Based Data-Server System</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Boeheim, C. ; Gowdy, S.J. ; Hanushevsky, A. ; Leith, D. ; Melen, R. ; Mount, R. ; Pulliam, T. ; Weeks, B.</creator><creatorcontrib>Boeheim, C. ; Gowdy, S.J. ; Hanushevsky, A. ; Leith, D. ; Melen, R. ; Mount, R. ; Pulliam, T. ; Weeks, B.</creatorcontrib><description>Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The PetaCache architecture aims at a minimum unit cost, highly scalable hardware and software approach that can take advantage of existing and emerging solid-state storage technologies providing data-access latencies in the range 10-100 microseconds. A prototype system has been constructed as a cluster of 64 nodes hosting a total of one terabyte of memory. Client processors retrieve data from the data-server nodes over a switched Ethernet infrastructure using SLAC's xrootd data-server software. The system is in use for performance testing, optimization and trial deployments for scientific data analysis. It also provides an excellent platform for testing new data access paradigms</description><identifier>ISSN: 1082-8907</identifier><identifier>ISBN: 1424403073</identifier><identifier>ISBN: 9781424403073</identifier><identifier>DOI: 10.1109/HPDC.2006.1652178</identifier><language>eng</language><publisher>IEEE</publisher><subject>Computer architecture ; Costs ; Data analysis ; Delay ; Ethernet networks ; Hardware ; Information retrieval ; Prototypes ; Software prototyping ; Solid state circuits</subject><ispartof>2006 15th IEEE International Conference on High Performance Distributed Computing, 2006, p.349-350</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/1652178$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,4050,4051,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/1652178$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Boeheim, C.</creatorcontrib><creatorcontrib>Gowdy, S.J.</creatorcontrib><creatorcontrib>Hanushevsky, A.</creatorcontrib><creatorcontrib>Leith, D.</creatorcontrib><creatorcontrib>Melen, R.</creatorcontrib><creatorcontrib>Mount, R.</creatorcontrib><creatorcontrib>Pulliam, T.</creatorcontrib><creatorcontrib>Weeks, B.</creatorcontrib><title>PetaCache: A memory-Based Data-Server System</title><title>2006 15th IEEE International Conference on High Performance Distributed Computing</title><addtitle>HPDC</addtitle><description>Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The PetaCache architecture aims at a minimum unit cost, highly scalable hardware and software approach that can take advantage of existing and emerging solid-state storage technologies providing data-access latencies in the range 10-100 microseconds. A prototype system has been constructed as a cluster of 64 nodes hosting a total of one terabyte of memory. Client processors retrieve data from the data-server nodes over a switched Ethernet infrastructure using SLAC's xrootd data-server software. The system is in use for performance testing, optimization and trial deployments for scientific data analysis. It also provides an excellent platform for testing new data access paradigms</description><subject>Computer architecture</subject><subject>Costs</subject><subject>Data analysis</subject><subject>Delay</subject><subject>Ethernet networks</subject><subject>Hardware</subject><subject>Information retrieval</subject><subject>Prototypes</subject><subject>Software prototyping</subject><subject>Solid state circuits</subject><issn>1082-8907</issn><isbn>1424403073</isbn><isbn>9781424403073</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2006</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotz8tKw0AUgOEBFWyrDyBu8gBOPJe5JO5qqrZQaKG6LjPJCUYMyiQIeXsX7erfffArdYeQI0L5uN6vqpwAXI7OEvriQs3RkDHA4PlSzRAK0kUJ_lrNh-ELgADJz9TDXsZQhfpTnrJl1kv_kyb9HAZpslUYgz5I-pOUHaZhlP5GXbXhe5Dbcxfq4_XlvVrr7e5tUy23ukPmQpvQigcxbXSldeQb00KMzlsiy41BWwdiw7GMbOsSKViI3rEYaMkWVnih7k9uJyLH39T1IU3H8xn_A8mHP2M</recordid><startdate>2006</startdate><enddate>2006</enddate><creator>Boeheim, C.</creator><creator>Gowdy, S.J.</creator><creator>Hanushevsky, A.</creator><creator>Leith, D.</creator><creator>Melen, R.</creator><creator>Mount, R.</creator><creator>Pulliam, T.</creator><creator>Weeks, B.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>2006</creationdate><title>PetaCache: A memory-Based Data-Server System</title><author>Boeheim, C. ; Gowdy, S.J. ; Hanushevsky, A. ; Leith, D. ; Melen, R. ; Mount, R. ; Pulliam, T. ; Weeks, B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i1338-4afe70e4fb695627d4f0bb6752253d415ca2343b9b35c912a50b763e40f2585e3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Computer architecture</topic><topic>Costs</topic><topic>Data analysis</topic><topic>Delay</topic><topic>Ethernet networks</topic><topic>Hardware</topic><topic>Information retrieval</topic><topic>Prototypes</topic><topic>Software prototyping</topic><topic>Solid state circuits</topic><toplevel>online_resources</toplevel><creatorcontrib>Boeheim, C.</creatorcontrib><creatorcontrib>Gowdy, S.J.</creatorcontrib><creatorcontrib>Hanushevsky, A.</creatorcontrib><creatorcontrib>Leith, D.</creatorcontrib><creatorcontrib>Melen, R.</creatorcontrib><creatorcontrib>Mount, R.</creatorcontrib><creatorcontrib>Pulliam, T.</creatorcontrib><creatorcontrib>Weeks, B.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Xplore</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Boeheim, C.</au><au>Gowdy, S.J.</au><au>Hanushevsky, A.</au><au>Leith, D.</au><au>Melen, R.</au><au>Mount, R.</au><au>Pulliam, T.</au><au>Weeks, B.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>PetaCache: A memory-Based Data-Server System</atitle><btitle>2006 15th IEEE International Conference on High Performance Distributed Computing</btitle><stitle>HPDC</stitle><date>2006</date><risdate>2006</risdate><spage>349</spage><epage>350</epage><pages>349-350</pages><issn>1082-8907</issn><isbn>1424403073</isbn><isbn>9781424403073</isbn><abstract>Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The PetaCache architecture aims at a minimum unit cost, highly scalable hardware and software approach that can take advantage of existing and emerging solid-state storage technologies providing data-access latencies in the range 10-100 microseconds. A prototype system has been constructed as a cluster of 64 nodes hosting a total of one terabyte of memory. Client processors retrieve data from the data-server nodes over a switched Ethernet infrastructure using SLAC's xrootd data-server software. The system is in use for performance testing, optimization and trial deployments for scientific data analysis. It also provides an excellent platform for testing new data access paradigms</abstract><pub>IEEE</pub><doi>10.1109/HPDC.2006.1652178</doi><tpages>2</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1082-8907 |
| ispartof | 2006 15th IEEE International Conference on High Performance Distributed Computing, 2006, p.349-350 |
| issn | 1082-8907 |
| language | eng |
| recordid | cdi_ieee_primary_1652178 |
| source | IEEE Electronic Library (IEL) Conference Proceedings |
| subjects | Computer architecture Costs Data analysis Delay Ethernet networks Hardware Information retrieval Prototypes Software prototyping Solid state circuits |
| title | PetaCache: A memory-Based Data-Server System |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T11%3A05%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=PetaCache:%20A%20memory-Based%20Data-Server%20System&rft.btitle=2006%2015th%20IEEE%20International%20Conference%20on%20High%20Performance%20Distributed%20Computing&rft.au=Boeheim,%20C.&rft.date=2006&rft.spage=349&rft.epage=350&rft.pages=349-350&rft.issn=1082-8907&rft.isbn=1424403073&rft.isbn_list=9781424403073&rft_id=info:doi/10.1109/HPDC.2006.1652178&rft_dat=%3Cieee_6IE%3E1652178%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=1652178&rfr_iscdi=true |