GrayWulf: Scalable Software Architecture for Data Intensive Computing
Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commo...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Tagungsbericht |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 10 |
|---|---|
| container_issue | |
| container_start_page | 1 |
| container_title | |
| container_volume | |
| creator | Simmhan, Y. Barga, R. van Ingen, C. Nieto-Santisteban, M. Dobos, L. Li, N. Shipway, M. Szalay, A.S. Werner, S. Heasley, J. |
| description | Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commodity servers similar to the well-known Beowulf clusters. We use the Pan-STARRS system currently under development as an example of the architecture and principles in action. |
| doi_str_mv | 10.1109/HICSS.2009.235 |
| format | Conference Proceeding |
| fullrecord | <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_4755781</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4755781</ieee_id><sourcerecordid>4755781</sourcerecordid><originalsourceid>FETCH-LOGICAL-i90t-b1bb5921ca3240b4f048e91866ec59a9575ad1cd3032adf82fa655e850c7277e3</originalsourceid><addsrcrecordid>eNotzMtKw0AUgOHBC1hrt27c5AVSz8zkzMVdibUNFFyk4LKcTM9oJL2QTJW-vYKufr7NL8S9hKmU4B-XVVnXUwXgp0rjhRgptCo3zqhLMfHWgTUedYGgr8RIooZcGsAbcTsMnwAKCmlGYr7o6fx26uJTVgfqqOk4qw8xfVPP2awPH23ikE6_iIc-e6ZEWbVPvB_aL87Kw-54Su3-_U5cR-oGnvx3LNYv83W5zFevi6qcrfLWQ8ob2TTolQykVQFNEaFw7KUzhgN68miRtjJsNWhF2-hUJIPIDiFYZS3rsXj427bMvDn27Y7686awiNZJ_QOeu0wi</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>GrayWulf: Scalable Software Architecture for Data Intensive Computing</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Simmhan, Y. ; Barga, R. ; van Ingen, C. ; Nieto-Santisteban, M. ; Dobos, L. ; Li, N. ; Shipway, M. ; Szalay, A.S. ; Werner, S. ; Heasley, J.</creator><creatorcontrib>Simmhan, Y. ; Barga, R. ; van Ingen, C. ; Nieto-Santisteban, M. ; Dobos, L. ; Li, N. ; Shipway, M. ; Szalay, A.S. ; Werner, S. ; Heasley, J.</creatorcontrib><description>Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commodity servers similar to the well-known Beowulf clusters. We use the Pan-STARRS system currently under development as an example of the architecture and principles in action.</description><identifier>ISSN: 1530-1605</identifier><identifier>ISBN: 9780769534503</identifier><identifier>ISBN: 0769534503</identifier><identifier>EISSN: 2572-6862</identifier><identifier>DOI: 10.1109/HICSS.2009.235</identifier><language>eng</language><publisher>IEEE</publisher><subject>Software architecture</subject><ispartof>2009 42nd Hawaii International Conference on System Sciences, 2009, p.1-10</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4755781$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4755781$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Simmhan, Y.</creatorcontrib><creatorcontrib>Barga, R.</creatorcontrib><creatorcontrib>van Ingen, C.</creatorcontrib><creatorcontrib>Nieto-Santisteban, M.</creatorcontrib><creatorcontrib>Dobos, L.</creatorcontrib><creatorcontrib>Li, N.</creatorcontrib><creatorcontrib>Shipway, M.</creatorcontrib><creatorcontrib>Szalay, A.S.</creatorcontrib><creatorcontrib>Werner, S.</creatorcontrib><creatorcontrib>Heasley, J.</creatorcontrib><title>GrayWulf: Scalable Software Architecture for Data Intensive Computing</title><title>2009 42nd Hawaii International Conference on System Sciences</title><addtitle>HICSS</addtitle><description>Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commodity servers similar to the well-known Beowulf clusters. We use the Pan-STARRS system currently under development as an example of the architecture and principles in action.</description><subject>Software architecture</subject><issn>1530-1605</issn><issn>2572-6862</issn><isbn>9780769534503</isbn><isbn>0769534503</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2009</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotzMtKw0AUgOHBC1hrt27c5AVSz8zkzMVdibUNFFyk4LKcTM9oJL2QTJW-vYKufr7NL8S9hKmU4B-XVVnXUwXgp0rjhRgptCo3zqhLMfHWgTUedYGgr8RIooZcGsAbcTsMnwAKCmlGYr7o6fx26uJTVgfqqOk4qw8xfVPP2awPH23ikE6_iIc-e6ZEWbVPvB_aL87Kw-54Su3-_U5cR-oGnvx3LNYv83W5zFevi6qcrfLWQ8ob2TTolQykVQFNEaFw7KUzhgN68miRtjJsNWhF2-hUJIPIDiFYZS3rsXj427bMvDn27Y7686awiNZJ_QOeu0wi</recordid><startdate>200901</startdate><enddate>200901</enddate><creator>Simmhan, Y.</creator><creator>Barga, R.</creator><creator>van Ingen, C.</creator><creator>Nieto-Santisteban, M.</creator><creator>Dobos, L.</creator><creator>Li, N.</creator><creator>Shipway, M.</creator><creator>Szalay, A.S.</creator><creator>Werner, S.</creator><creator>Heasley, J.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>200901</creationdate><title>GrayWulf: Scalable Software Architecture for Data Intensive Computing</title><author>Simmhan, Y. ; Barga, R. ; van Ingen, C. ; Nieto-Santisteban, M. ; Dobos, L. ; Li, N. ; Shipway, M. ; Szalay, A.S. ; Werner, S. ; Heasley, J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i90t-b1bb5921ca3240b4f048e91866ec59a9575ad1cd3032adf82fa655e850c7277e3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Software architecture</topic><toplevel>online_resources</toplevel><creatorcontrib>Simmhan, Y.</creatorcontrib><creatorcontrib>Barga, R.</creatorcontrib><creatorcontrib>van Ingen, C.</creatorcontrib><creatorcontrib>Nieto-Santisteban, M.</creatorcontrib><creatorcontrib>Dobos, L.</creatorcontrib><creatorcontrib>Li, N.</creatorcontrib><creatorcontrib>Shipway, M.</creatorcontrib><creatorcontrib>Szalay, A.S.</creatorcontrib><creatorcontrib>Werner, S.</creatorcontrib><creatorcontrib>Heasley, J.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Simmhan, Y.</au><au>Barga, R.</au><au>van Ingen, C.</au><au>Nieto-Santisteban, M.</au><au>Dobos, L.</au><au>Li, N.</au><au>Shipway, M.</au><au>Szalay, A.S.</au><au>Werner, S.</au><au>Heasley, J.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>GrayWulf: Scalable Software Architecture for Data Intensive Computing</atitle><btitle>2009 42nd Hawaii International Conference on System Sciences</btitle><stitle>HICSS</stitle><date>2009-01</date><risdate>2009</risdate><spage>1</spage><epage>10</epage><pages>1-10</pages><issn>1530-1605</issn><eissn>2572-6862</eissn><isbn>9780769534503</isbn><isbn>0769534503</isbn><abstract>Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commodity servers similar to the well-known Beowulf clusters. We use the Pan-STARRS system currently under development as an example of the architecture and principles in action.</abstract><pub>IEEE</pub><doi>10.1109/HICSS.2009.235</doi><tpages>10</tpages></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1530-1605 |
| ispartof | 2009 42nd Hawaii International Conference on System Sciences, 2009, p.1-10 |
| issn | 1530-1605 2572-6862 |
| language | eng |
| recordid | cdi_ieee_primary_4755781 |
| source | IEEE Electronic Library (IEL) Conference Proceedings |
| subjects | Software architecture |
| title | GrayWulf: Scalable Software Architecture for Data Intensive Computing |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T17%3A18%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=GrayWulf:%20Scalable%20Software%20Architecture%20for%20Data%20Intensive%20Computing&rft.btitle=2009%2042nd%20Hawaii%20International%20Conference%20on%20System%20Sciences&rft.au=Simmhan,%20Y.&rft.date=2009-01&rft.spage=1&rft.epage=10&rft.pages=1-10&rft.issn=1530-1605&rft.eissn=2572-6862&rft.isbn=9780769534503&rft.isbn_list=0769534503&rft_id=info:doi/10.1109/HICSS.2009.235&rft_dat=%3Cieee_6IE%3E4755781%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=4755781&rfr_iscdi=true |