Revamping the OSCAR database: a flexible approach to cluster configuration data management

The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in eac...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kim, D., Squyres, J.M., Lumsdaine, A.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 332
container_issue
container_start_page 326
container_title
container_volume
creator Kim, D.
Squyres, J.M.
Lumsdaine, A.
description The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.
doi_str_mv 10.1109/HPCS.2005.45
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_1430090</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>1430090</ieee_id><sourcerecordid>1430090</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-3bd310439ba4894cb9ec5f096982eaceafa87eecf158143e09168f628e19c1413</originalsourceid><addsrcrecordid>eNotjktPwkAUhSc-EhHZuXMzf6B459XOuCONiAkJBnTjhtwOd2BMX2mL0X8vUc_mbL7z5TB2K2AqBLj7xUu-mUoAM9XmjI2kymwiwblzdg1Z6oxUWrkLNhLGQGKkVlds0vcfcIpyBjIxYu9r-sSqjfWeDwfiq00-W_MdDlhgTw8ceSjpKxYlcWzbrkF_4EPDfXnsB-q4b-oQ98cOh9jUvzNeYY17qqgebthlwLKnyX-P2dv88TVfJMvV03M-WyZRZGZIVLFTAk5HC9TWaV848iaAS52VhJ4woM2IfBDGCq0InEhtSKUl4bzQQo3Z3Z83EtG27WKF3ff2hAI4UD_bXlOa</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</creator><creatorcontrib>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</creatorcontrib><description>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</description><identifier>ISSN: 1550-5243</identifier><identifier>ISBN: 0769523439</identifier><identifier>ISBN: 9780769523439</identifier><identifier>EISSN: 2378-2099</identifier><identifier>DOI: 10.1109/HPCS.2005.45</identifier><language>eng</language><publisher>IEEE</publisher><subject>Application software ; High performance computing ; Laboratories ; Open source software ; Open systems ; Software maintenance ; Software performance ; Software tools ; Technology management</subject><ispartof>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05), 2005, p.326-332</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/1430090$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>310,311,781,785,790,791,2059,4051,4052,27929,54924</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/1430090$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Kim, D.</creatorcontrib><creatorcontrib>Squyres, J.M.</creatorcontrib><creatorcontrib>Lumsdaine, A.</creatorcontrib><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><title>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05)</title><addtitle>HPCSA</addtitle><description>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</description><subject>Application software</subject><subject>High performance computing</subject><subject>Laboratories</subject><subject>Open source software</subject><subject>Open systems</subject><subject>Software maintenance</subject><subject>Software performance</subject><subject>Software tools</subject><subject>Technology management</subject><issn>1550-5243</issn><issn>2378-2099</issn><isbn>0769523439</isbn><isbn>9780769523439</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2005</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotjktPwkAUhSc-EhHZuXMzf6B459XOuCONiAkJBnTjhtwOd2BMX2mL0X8vUc_mbL7z5TB2K2AqBLj7xUu-mUoAM9XmjI2kymwiwblzdg1Z6oxUWrkLNhLGQGKkVlds0vcfcIpyBjIxYu9r-sSqjfWeDwfiq00-W_MdDlhgTw8ceSjpKxYlcWzbrkF_4EPDfXnsB-q4b-oQ98cOh9jUvzNeYY17qqgebthlwLKnyX-P2dv88TVfJMvV03M-WyZRZGZIVLFTAk5HC9TWaV848iaAS52VhJ4woM2IfBDGCq0InEhtSKUl4bzQQo3Z3Z83EtG27WKF3ff2hAI4UD_bXlOa</recordid><startdate>2005</startdate><enddate>2005</enddate><creator>Kim, D.</creator><creator>Squyres, J.M.</creator><creator>Lumsdaine, A.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>2005</creationdate><title>Revamping the OSCAR database: a flexible approach to cluster configuration data management</title><author>Kim, D. ; Squyres, J.M. ; Lumsdaine, A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-3bd310439ba4894cb9ec5f096982eaceafa87eecf158143e09168f628e19c1413</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2005</creationdate><topic>Application software</topic><topic>High performance computing</topic><topic>Laboratories</topic><topic>Open source software</topic><topic>Open systems</topic><topic>Software maintenance</topic><topic>Software performance</topic><topic>Software tools</topic><topic>Technology management</topic><toplevel>online_resources</toplevel><creatorcontrib>Kim, D.</creatorcontrib><creatorcontrib>Squyres, J.M.</creatorcontrib><creatorcontrib>Lumsdaine, A.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Kim, D.</au><au>Squyres, J.M.</au><au>Lumsdaine, A.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Revamping the OSCAR database: a flexible approach to cluster configuration data management</atitle><btitle>19th International Symposium on High Performance Computing Systems and Applications (HPCS'05)</btitle><stitle>HPCSA</stitle><date>2005</date><risdate>2005</risdate><spage>326</spage><epage>332</epage><pages>326-332</pages><issn>1550-5243</issn><eissn>2378-2099</eissn><isbn>0769523439</isbn><isbn>9780769523439</isbn><abstract>The OSCAR (T. Naughton et al., 2002) cluster installation toolkit started life as the result of an ad-hoc working group attempting to bundle a set of "best practices" for building clusters into a single software solution. Although mainly developed as "skunk works" projects in each of the participating institutions, the OSCAR toolkit has gained a large following, boasting hundreds of thousands of downloads and active mailing lists. The original OSCAR toolkit was aimed at one particular type of high performance computing (HPC) cluster. Since then, several sub-projects targeting other types of HPC clusters have been spun off the main working group's efforts. Each of these projects share a core set of OSCAR code, including the OSCAR database and its access API, "ODA" (OSCAR Database API). The ODA abstraction layer - consisting of a database schema and corresponding API - hides a commodity back-end database (e.g., MySQL). As OSCAR and its derivatives are targeted at new, innovative environments (to include non-HPC environments), the configuration management issues that OSCAR must handle have grown exponentially. As such, its current database schema for holding the cluster configuration is starting to show its age - it is simply unable to represent the complex, ever-growing set of data required to accurately describe the clusters that it manages. ODA's API is overly complex, requiring a steep learning curve for OSCAR developers. This paper proposes a simpler, highly flexible design and implementation that allow ODA to not only handle all the data that ODA currently manages, but also allow expansion into new types of clusters, enable storage and retrieval of configuration information in a variety of different formats, and encourage data re-use between the main OSCAR project and its derivative packages.</abstract><pub>IEEE</pub><doi>10.1109/HPCS.2005.45</doi><tpages>7</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1550-5243
ispartof 19th International Symposium on High Performance Computing Systems and Applications (HPCS'05), 2005, p.326-332
issn 1550-5243
2378-2099
language eng
recordid cdi_ieee_primary_1430090
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Application software
High performance computing
Laboratories
Open source software
Open systems
Software maintenance
Software performance
Software tools
Technology management
title Revamping the OSCAR database: a flexible approach to cluster configuration data management
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-17T05%3A20%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Revamping%20the%20OSCAR%20database:%20a%20flexible%20approach%20to%20cluster%20configuration%20data%20management&rft.btitle=19th%20International%20Symposium%20on%20High%20Performance%20Computing%20Systems%20and%20Applications%20(HPCS'05)&rft.au=Kim,%20D.&rft.date=2005&rft.spage=326&rft.epage=332&rft.pages=326-332&rft.issn=1550-5243&rft.eissn=2378-2099&rft.isbn=0769523439&rft.isbn_list=9780769523439&rft_id=info:doi/10.1109/HPCS.2005.45&rft_dat=%3Cieee_6IE%3E1430090%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=1430090&rfr_iscdi=true