Combining workstations and supercomputers to support grid applications: the parallel tomography experience

Computational grids are becoming an increasingly important and powerful platform for the execution of large-scale, resource-intensive applications. However, it remains a challenge for applications to tap into the potential of grid resources in order to achieve performance. In this paper, we illustra...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Smallen, S., Crine, W., Frey, J., Berman, F., Wolski, R., Mei-Hui Su, Kesselman, C., Young, S., Ellisman, M.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 252
container_issue
container_start_page 241
container_title
container_volume
creator Smallen, S.
Crine, W.
Frey, J.
Berman, F.
Wolski, R.
Mei-Hui Su
Kesselman, C.
Young, S.
Ellisman, M.
description Computational grids are becoming an increasingly important and powerful platform for the execution of large-scale, resource-intensive applications. However, it remains a challenge for applications to tap into the potential of grid resources in order to achieve performance. In this paper, we illustrate how work queue applications can leverage grids to achieve performance through coallocation. We describe our experiences in developing a scheduling strategy for a production tomography application targeted at grids that contain both workstations and parallel supercomputers. Our strategy uses dynamic information exported by a supercomputer's batch scheduler to simultaneously schedule tasks on workstations and immediately-available supercomputer nodes. This strategy is of great practical interest because it combines resources that are available in a typical research laboratory: time-shared workstations and CPU time in remote space-shared supercomputers. We show that this strategy improves the performance of the tomography application compared to traditional scheduling strategies, which target the application to either type of resource alone.
doi_str_mv 10.1109/HCW.2000.843748
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_843748</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>843748</ieee_id><sourcerecordid>843748</sourcerecordid><originalsourceid>FETCH-LOGICAL-c1068-b7a6dbe4601ebb9dfbab8cdf5e03f6de516bdfabe1e7f2fe5e9ef1542641c2073</originalsourceid><addsrcrecordid>eNotkF1LwzAYhYMf4Da9FrzKH-h8kzZJ650UdcLAG8XLkTRvtsy2CWmH7t9bmVcHDs95Lg4htwyWjEF1v6o_lxwAlmWRq6I8IzM-ZVZWqjgnc1CyEiCE5BdkNuEqExyqKzIfhj3AtFNsRvZ16Izvfb-l3yF9DaMefegHqntLh0PE1IQuHkZMAx3DXxNDGuk2eUt1jK1vTvwDHXdIo066bbGd0C5sk467I8WfSeKxb_CaXDrdDnjznwvy8fz0Xq-y9dvLa_24zhoGssyM0tIaLCQwNKayzmhTNtYJhNxJi4JJY502yFA57lBghY6JgsuCNRxUviB3J69HxE1MvtPpuDldlP8C53hdGA</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Combining workstations and supercomputers to support grid applications: the parallel tomography experience</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Smallen, S. ; Crine, W. ; Frey, J. ; Berman, F. ; Wolski, R. ; Mei-Hui Su ; Kesselman, C. ; Young, S. ; Ellisman, M.</creator><creatorcontrib>Smallen, S. ; Crine, W. ; Frey, J. ; Berman, F. ; Wolski, R. ; Mei-Hui Su ; Kesselman, C. ; Young, S. ; Ellisman, M.</creatorcontrib><description>Computational grids are becoming an increasingly important and powerful platform for the execution of large-scale, resource-intensive applications. However, it remains a challenge for applications to tap into the potential of grid resources in order to achieve performance. In this paper, we illustrate how work queue applications can leverage grids to achieve performance through coallocation. We describe our experiences in developing a scheduling strategy for a production tomography application targeted at grids that contain both workstations and parallel supercomputers. Our strategy uses dynamic information exported by a supercomputer's batch scheduler to simultaneously schedule tasks on workstations and immediately-available supercomputer nodes. This strategy is of great practical interest because it combines resources that are available in a typical research laboratory: time-shared workstations and CPU time in remote space-shared supercomputers. We show that this strategy improves the performance of the tomography application compared to traditional scheduling strategies, which target the application to either type of resource alone.</description><identifier>ISSN: 1097-5209</identifier><identifier>ISBN: 0769505562</identifier><identifier>ISBN: 9780769505565</identifier><identifier>EISSN: 2374-8974</identifier><identifier>DOI: 10.1109/HCW.2000.843748</identifier><language>eng</language><publisher>IEEE</publisher><subject>Application software ; Computer science ; Contracts ; Grid computing ; Identity-based encryption ; Microscopy ; Processor scheduling ; Supercomputers ; Tomography ; Workstations</subject><ispartof>Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556), 2000, p.241-252</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c1068-b7a6dbe4601ebb9dfbab8cdf5e03f6de516bdfabe1e7f2fe5e9ef1542641c2073</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/843748$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,777,781,786,787,2052,4036,4037,27906,54901</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/843748$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Smallen, S.</creatorcontrib><creatorcontrib>Crine, W.</creatorcontrib><creatorcontrib>Frey, J.</creatorcontrib><creatorcontrib>Berman, F.</creatorcontrib><creatorcontrib>Wolski, R.</creatorcontrib><creatorcontrib>Mei-Hui Su</creatorcontrib><creatorcontrib>Kesselman, C.</creatorcontrib><creatorcontrib>Young, S.</creatorcontrib><creatorcontrib>Ellisman, M.</creatorcontrib><title>Combining workstations and supercomputers to support grid applications: the parallel tomography experience</title><title>Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556)</title><addtitle>HCW</addtitle><description>Computational grids are becoming an increasingly important and powerful platform for the execution of large-scale, resource-intensive applications. However, it remains a challenge for applications to tap into the potential of grid resources in order to achieve performance. In this paper, we illustrate how work queue applications can leverage grids to achieve performance through coallocation. We describe our experiences in developing a scheduling strategy for a production tomography application targeted at grids that contain both workstations and parallel supercomputers. Our strategy uses dynamic information exported by a supercomputer's batch scheduler to simultaneously schedule tasks on workstations and immediately-available supercomputer nodes. This strategy is of great practical interest because it combines resources that are available in a typical research laboratory: time-shared workstations and CPU time in remote space-shared supercomputers. We show that this strategy improves the performance of the tomography application compared to traditional scheduling strategies, which target the application to either type of resource alone.</description><subject>Application software</subject><subject>Computer science</subject><subject>Contracts</subject><subject>Grid computing</subject><subject>Identity-based encryption</subject><subject>Microscopy</subject><subject>Processor scheduling</subject><subject>Supercomputers</subject><subject>Tomography</subject><subject>Workstations</subject><issn>1097-5209</issn><issn>2374-8974</issn><isbn>0769505562</isbn><isbn>9780769505565</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2000</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotkF1LwzAYhYMf4Da9FrzKH-h8kzZJ650UdcLAG8XLkTRvtsy2CWmH7t9bmVcHDs95Lg4htwyWjEF1v6o_lxwAlmWRq6I8IzM-ZVZWqjgnc1CyEiCE5BdkNuEqExyqKzIfhj3AtFNsRvZ16Izvfb-l3yF9DaMefegHqntLh0PE1IQuHkZMAx3DXxNDGuk2eUt1jK1vTvwDHXdIo066bbGd0C5sk467I8WfSeKxb_CaXDrdDnjznwvy8fz0Xq-y9dvLa_24zhoGssyM0tIaLCQwNKayzmhTNtYJhNxJi4JJY502yFA57lBghY6JgsuCNRxUviB3J69HxE1MvtPpuDldlP8C53hdGA</recordid><startdate>2000</startdate><enddate>2000</enddate><creator>Smallen, S.</creator><creator>Crine, W.</creator><creator>Frey, J.</creator><creator>Berman, F.</creator><creator>Wolski, R.</creator><creator>Mei-Hui Su</creator><creator>Kesselman, C.</creator><creator>Young, S.</creator><creator>Ellisman, M.</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>2000</creationdate><title>Combining workstations and supercomputers to support grid applications: the parallel tomography experience</title><author>Smallen, S. ; Crine, W. ; Frey, J. ; Berman, F. ; Wolski, R. ; Mei-Hui Su ; Kesselman, C. ; Young, S. ; Ellisman, M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c1068-b7a6dbe4601ebb9dfbab8cdf5e03f6de516bdfabe1e7f2fe5e9ef1542641c2073</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2000</creationdate><topic>Application software</topic><topic>Computer science</topic><topic>Contracts</topic><topic>Grid computing</topic><topic>Identity-based encryption</topic><topic>Microscopy</topic><topic>Processor scheduling</topic><topic>Supercomputers</topic><topic>Tomography</topic><topic>Workstations</topic><toplevel>online_resources</toplevel><creatorcontrib>Smallen, S.</creatorcontrib><creatorcontrib>Crine, W.</creatorcontrib><creatorcontrib>Frey, J.</creatorcontrib><creatorcontrib>Berman, F.</creatorcontrib><creatorcontrib>Wolski, R.</creatorcontrib><creatorcontrib>Mei-Hui Su</creatorcontrib><creatorcontrib>Kesselman, C.</creatorcontrib><creatorcontrib>Young, S.</creatorcontrib><creatorcontrib>Ellisman, M.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Smallen, S.</au><au>Crine, W.</au><au>Frey, J.</au><au>Berman, F.</au><au>Wolski, R.</au><au>Mei-Hui Su</au><au>Kesselman, C.</au><au>Young, S.</au><au>Ellisman, M.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Combining workstations and supercomputers to support grid applications: the parallel tomography experience</atitle><btitle>Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556)</btitle><stitle>HCW</stitle><date>2000</date><risdate>2000</risdate><spage>241</spage><epage>252</epage><pages>241-252</pages><issn>1097-5209</issn><eissn>2374-8974</eissn><isbn>0769505562</isbn><isbn>9780769505565</isbn><abstract>Computational grids are becoming an increasingly important and powerful platform for the execution of large-scale, resource-intensive applications. However, it remains a challenge for applications to tap into the potential of grid resources in order to achieve performance. In this paper, we illustrate how work queue applications can leverage grids to achieve performance through coallocation. We describe our experiences in developing a scheduling strategy for a production tomography application targeted at grids that contain both workstations and parallel supercomputers. Our strategy uses dynamic information exported by a supercomputer's batch scheduler to simultaneously schedule tasks on workstations and immediately-available supercomputer nodes. This strategy is of great practical interest because it combines resources that are available in a typical research laboratory: time-shared workstations and CPU time in remote space-shared supercomputers. We show that this strategy improves the performance of the tomography application compared to traditional scheduling strategies, which target the application to either type of resource alone.</abstract><pub>IEEE</pub><doi>10.1109/HCW.2000.843748</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1097-5209
ispartof Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556), 2000, p.241-252
issn 1097-5209
2374-8974
language eng
recordid cdi_ieee_primary_843748
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Application software
Computer science
Contracts
Grid computing
Identity-based encryption
Microscopy
Processor scheduling
Supercomputers
Tomography
Workstations
title Combining workstations and supercomputers to support grid applications: the parallel tomography experience
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T14%3A49%3A37IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Combining%20workstations%20and%20supercomputers%20to%20support%20grid%20applications:%20the%20parallel%20tomography%20experience&rft.btitle=Proceedings%209th%20Heterogeneous%20Computing%20Workshop%20(HCW%202000)%20(Cat.%20No.PR00556)&rft.au=Smallen,%20S.&rft.date=2000&rft.spage=241&rft.epage=252&rft.pages=241-252&rft.issn=1097-5209&rft.eissn=2374-8974&rft.isbn=0769505562&rft.isbn_list=9780769505565&rft_id=info:doi/10.1109/HCW.2000.843748&rft_dat=%3Cieee_6IE%3E843748%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=843748&rfr_iscdi=true