Revamping the OSCAR database: a flexible approach to cluster configuration data management
The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in eac...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Tagungsbericht |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 332 |
---|---|
container_issue | |
container_start_page | 326 |
container_title | |
container_volume | |
creator | Kim, D. Squyres, J.M. Lumsdaine, A. |
description | The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages. |
doi_str_mv | 10.1109/HPCS.2005.45 |
format | Conference Proceeding |
fullrecord | <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_1430090</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>1430090</ieee_id><sourcerecordid>1430090</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-3bd310439ba4894cb9ec5f096982eaceafa87eecf158143e09168f628e19c1413</originalsourceid><addsrcrecordid>eNotjktPwkAUhSc-EhHZuXMzf6B459XOuCONiAkJBnTjhtwOd2BMX2mL0X8vUc_mbL7z5TB2K2AqBLj7xUu-mUoAM9XmjI2kymwiwblzdg1Z6oxUWrkLNhLGQGKkVlds0vcfcIpyBjIxYu9r-sSqjfWeDwfiq00-W_MdDlhgTw8ceSjpKxYlcWzbrkF_4EPDfXnsB-q4b-oQ98cOh9jUvzNeYY17qqgebthlwLKnyX-P2dv88TVfJMvV03M-WyZRZGZIVLFTAk5HC9TWaV848iaAS52VhJ4woM2IfBDGCq0InEhtSKUl4bzQQo3Z3Z83EtG27WKF3ff2hAI4UD_bXlOa</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</creator><creatorcontrib>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</creatorcontrib><description>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</description><identifier>ISSN: 1550-5243</identifier><identifier>ISBN: 0769523439</identifier><identifier>ISBN: 9780769523439</identifier><identifier>EISSN: 2378-2099</identifier><identifier>DOI: 10.1109/HPCS.2005.45</identifier><language>eng</language><publisher>IEEE</publisher><subject>Application software ; High performance computing ; Laboratories ; Open source software ; Open systems ; Software maintenance ; Software performance ; Software tools ; Technology management</subject><ispartof>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05), 2005, p.326-332</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/1430090$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>310,311,781,785,790,791,2059,4051,4052,27929,54924</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/1430090$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Kim, D.</creatorcontrib><creatorcontrib>Squyres, J.M.</creatorcontrib><creatorcontrib>Lumsdaine, A.</creatorcontrib><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><title>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05)</title><addtitle>HPCSA</addtitle><description>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</description><subject>Application software</subject><subject>High performance computing</subject><subject>Laboratories</subject><subject>Open source software</subject><subject>Open systems</subject><subject>Software maintenance</subject><subject>Software performance</subject><subject>Software tools</subject><subject>Technology management</subject><issn>1550-5243</issn><issn>2378-2099</issn><isbn>0769523439</isbn><isbn>9780769523439</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2005</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotjktPwkAUhSc-EhHZuXMzf6B459XOuCONiAkJBnTjhtwOd2BMX2mL0X8vUc_mbL7z5TB2K2AqBLj7xUu-mUoAM9XmjI2kymwiwblzdg1Z6oxUWrkLNhLGQGKkVlds0vcfcIpyBjIxYu9r-sSqjfWeDwfiq00-W_MdDlhgTw8ceSjpKxYlcWzbrkF_4EPDfXnsB-q4b-oQ98cOh9jUvzNeYY17qqgebthlwLKnyX-P2dv88TVfJMvV03M-WyZRZGZIVLFTAk5HC9TWaV848iaAS52VhJ4woM2IfBDGCq0InEhtSKUl4bzQQo3Z3Z83EtG27WKF3ff2hAI4UD_bXlOa</recordid><startdate>2005</startdate><enddate>2005</enddate><creator>Kim, D.</creator><creator>Squyres, J.M.</creator><creator>Lumsdaine, A.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>2005</creationdate><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><author>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-3bd310439ba4894cb9ec5f096982eaceafa87eecf158143e09168f628e19c1413</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2005</creationdate><topic>Application software</topic><topic>High performance computing</topic><topic>Laboratories</topic><topic>Open source software</topic><topic>Open systems</topic><topic>Software maintenance</topic><topic>Software performance</topic><topic>Software tools</topic><topic>Technology management</topic><toplevel>online_resources</toplevel><creatorcontrib>Kim, D.</creatorcontrib><creatorcontrib>Squyres, J.M.</creatorcontrib><creatorcontrib>Lumsdaine, A.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Kim, D.</au><au>Squyres, J.M.</au><au>Lumsdaine, A.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Revamping the OSCAR database: a flexible approach to cluster configuration data management</atitle><btitle>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05)</btitle><stitle>HPCSA</stitle><date>2005</date><risdate>2005</risdate><spage>326</spage><epage>332</epage><pages>326-332</pages><issn>1550-5243</issn><eissn>2378-2099</eissn><isbn>0769523439</isbn><isbn>9780769523439</isbn><abstract>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</abstract><pub>IEEE</pub><doi>10.1109/HPCS.2005.45</doi><tpages>7</tpages></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1550-5243 |
ispartof | 19th International Symposium on High Performance Computing Systems and Applications (HPCS'05), 2005, p.326-332 |
issn | 1550-5243 2378-2099 |
language | eng |
recordid | cdi_ieee_primary_1430090 |
source | IEEE Electronic Library (IEL) Conference Proceedings |
subjects | Application software High performance computing Laboratories Open source software Open systems Software maintenance Software performance Software tools Technology management |
title | Revamping the OSCAR database: a flexible approach to cluster configuration data management |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-17T05%3A20%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Revamping%20the%20OSCAR%20database:%20a%20flexible%20approach%20to%20cluster%20configuration%20data%20management&rft.btitle=19th%20International%20Symposium%20on%20High%20Performance%20Computing%20Systems%20and%20Applications%20(HPCS'05)&rft.au=Kim,%20D.&rft.date=2005&rft.spage=326&rft.epage=332&rft.pages=326-332&rft.issn=1550-5243&rft.eissn=2378-2099&rft.isbn=0769523439&rft.isbn_list=9780769523439&rft_id=info:doi/10.1109/HPCS.2005.45&rft_dat=%3Cieee_6IE%3E1430090%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=1430090&rfr_iscdi=true |