Software Testing and Verification in Climate Model Development

Over the past 30 years, most climate models have grown from relatively simple representations of a few atmospheric processes to complex multidisciplinary systems. Computer infrastructure over that period has gone from punchcard mainframes to modern parallel clusters. Model implementations have becom...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE software 2011-11, Vol.28 (6), p.49-55
Hauptverfasser: Clune, T. L., Rood, R. B.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 55
container_issue 6
container_start_page 49
container_title IEEE software
container_volume 28
creator Clune, T. L.
Rood, R. B.
description Over the past 30 years, most climate models have grown from relatively simple representations of a few atmospheric processes to complex multidisciplinary systems. Computer infrastructure over that period has gone from punchcard mainframes to modern parallel clusters. Model implementations have become complex, brittle, and increasingly difficult to extend and maintain. Verification processes for model implementations rely almost exclusively on some combination of detailed analyses of output from full climate simulations and system-level regression tests. Besides being costly in terms of developer time and computing resources, these testing methodologies are limited in the types of defects they can detect, isolate, and diagnose. Mitigating these weaknesses of coarse-grained testing with finer-grained unit tests has been perceived as cumbersome and counterproductive. Recent advances in commercial software tools and methodologies have led to a renaissance of systematic fine-grained testing. This opens new possibilities for testing climate-modeling-software methodologies.
doi_str_mv 10.1109/MS.2011.117
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_5999647</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5999647</ieee_id><sourcerecordid>2488643891</sourcerecordid><originalsourceid>FETCH-LOGICAL-c358t-8c1195d16ebbca8946f123ff9303c06bfe8f9d6b17d73a5ca1e1c183e0b3c8b33</originalsourceid><addsrcrecordid>eNo9kE1LAzEYhIMoWKsnj16CV9mat8lukosg9RNaPLR6DdnsG0nZbmp2q_jvjVQ8DQMPM8MQcg5sAsD09WI5mTKAbOQBGYHmshCgxSEZMSlYIUWpj8lJ368ZYyVwNiI3y-iHL5uQrrAfQvdObdfQN0zBB2eHEDsaOjprw8YOSBexwZbe4Se2cbvBbjglR962PZ796Zi8PtyvZk_F_OXxeXY7Lxwv1VAoB6DLBiqsa2eVFpWHKfdec8Ydq2qPyuumqkE2ktvSWUBwoDiymjtVcz4ml_vcbYofu7zUrOMudbnSKK2UgEqxDF3tIZdi3yf0Zpvy7vRtgJnff8xiaX7_yUZm-mJPB0T8J0utdSUk_wE9eWA9</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>898841680</pqid></control><display><type>article</type><title>Software Testing and Verification in Climate Model Development</title><source>IEEE Electronic Library (IEL)</source><creator>Clune, T. L. ; Rood, R. B.</creator><creatorcontrib>Clune, T. L. ; Rood, R. B.</creatorcontrib><description>Over the past 30 years, most climate models have grown from relatively simple representations of a few atmospheric processes to complex multidisciplinary systems. Computer infrastructure over that period has gone from punchcard mainframes to modern parallel clusters. Model implementations have become complex, brittle, and increasingly difficult to extend and maintain. Verification processes for model implementations rely almost exclusively on some combination of detailed analyses of output from full climate simulations and system-level regression tests. Besides being costly in terms of developer time and computing resources, these testing methodologies are limited in the types of defects they can detect, isolate, and diagnose. Mitigating these weaknesses of coarse-grained testing with finer-grained unit tests has been perceived as cumbersome and counterproductive. Recent advances in commercial software tools and methodologies have led to a renaissance of systematic fine-grained testing. This opens new possibilities for testing climate-modeling-software methodologies.</description><identifier>ISSN: 0740-7459</identifier><identifier>EISSN: 1937-4194</identifier><identifier>DOI: 10.1109/MS.2011.117</identifier><identifier>CODEN: IESOEG</identifier><language>eng</language><publisher>Los Alamitos: IEEE</publisher><subject>Atmospheric measurements ; Atmospheric modeling ; Automation ; Climate change ; Computational modeling ; Computer programming ; Global warming ; Infrastructure ; Meteorology ; Numerical models ; program verification ; Software development ; Software engineering ; Software reliability ; testing and debugging ; testing strategies</subject><ispartof>IEEE software, 2011-11, Vol.28 (6), p.49-55</ispartof><rights>Copyright IEEE Computer Society Nov/Dec 2011</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c358t-8c1195d16ebbca8946f123ff9303c06bfe8f9d6b17d73a5ca1e1c183e0b3c8b33</citedby><cites>FETCH-LOGICAL-c358t-8c1195d16ebbca8946f123ff9303c06bfe8f9d6b17d73a5ca1e1c183e0b3c8b33</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5999647$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5999647$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Clune, T. L.</creatorcontrib><creatorcontrib>Rood, R. B.</creatorcontrib><title>Software Testing and Verification in Climate Model Development</title><title>IEEE software</title><addtitle>S-M</addtitle><description>Over the past 30 years, most climate models have grown from relatively simple representations of a few atmospheric processes to complex multidisciplinary systems. Computer infrastructure over that period has gone from punchcard mainframes to modern parallel clusters. Model implementations have become complex, brittle, and increasingly difficult to extend and maintain. Verification processes for model implementations rely almost exclusively on some combination of detailed analyses of output from full climate simulations and system-level regression tests. Besides being costly in terms of developer time and computing resources, these testing methodologies are limited in the types of defects they can detect, isolate, and diagnose. Mitigating these weaknesses of coarse-grained testing with finer-grained unit tests has been perceived as cumbersome and counterproductive. Recent advances in commercial software tools and methodologies have led to a renaissance of systematic fine-grained testing. This opens new possibilities for testing climate-modeling-software methodologies.</description><subject>Atmospheric measurements</subject><subject>Atmospheric modeling</subject><subject>Automation</subject><subject>Climate change</subject><subject>Computational modeling</subject><subject>Computer programming</subject><subject>Global warming</subject><subject>Infrastructure</subject><subject>Meteorology</subject><subject>Numerical models</subject><subject>program verification</subject><subject>Software development</subject><subject>Software engineering</subject><subject>Software reliability</subject><subject>testing and debugging</subject><subject>testing strategies</subject><issn>0740-7459</issn><issn>1937-4194</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2011</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><sourceid>8G5</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNo9kE1LAzEYhIMoWKsnj16CV9mat8lukosg9RNaPLR6DdnsG0nZbmp2q_jvjVQ8DQMPM8MQcg5sAsD09WI5mTKAbOQBGYHmshCgxSEZMSlYIUWpj8lJ368ZYyVwNiI3y-iHL5uQrrAfQvdObdfQN0zBB2eHEDsaOjprw8YOSBexwZbe4Se2cbvBbjglR962PZ796Zi8PtyvZk_F_OXxeXY7Lxwv1VAoB6DLBiqsa2eVFpWHKfdec8Ydq2qPyuumqkE2ktvSWUBwoDiymjtVcz4ml_vcbYofu7zUrOMudbnSKK2UgEqxDF3tIZdi3yf0Zpvy7vRtgJnff8xiaX7_yUZm-mJPB0T8J0utdSUk_wE9eWA9</recordid><startdate>20111101</startdate><enddate>20111101</enddate><creator>Clune, T. L.</creator><creator>Rood, R. B.</creator><general>IEEE</general><general>IEEE Computer Society</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>88F</scope><scope>88I</scope><scope>88K</scope><scope>8AL</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L6V</scope><scope>M0C</scope><scope>M0N</scope><scope>M1Q</scope><scope>M2O</scope><scope>M2P</scope><scope>M2T</scope><scope>M7S</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>Q9U</scope></search><sort><creationdate>20111101</creationdate><title>Software Testing and Verification in Climate Model Development</title><author>Clune, T. L. ; Rood, R. B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c358t-8c1195d16ebbca8946f123ff9303c06bfe8f9d6b17d73a5ca1e1c183e0b3c8b33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2011</creationdate><topic>Atmospheric measurements</topic><topic>Atmospheric modeling</topic><topic>Automation</topic><topic>Climate change</topic><topic>Computational modeling</topic><topic>Computer programming</topic><topic>Global warming</topic><topic>Infrastructure</topic><topic>Meteorology</topic><topic>Numerical models</topic><topic>program verification</topic><topic>Software development</topic><topic>Software engineering</topic><topic>Software reliability</topic><topic>testing and debugging</topic><topic>testing strategies</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Clune, T. L.</creatorcontrib><creatorcontrib>Rood, R. B.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Military Database (Alumni Edition)</collection><collection>Science Database (Alumni Edition)</collection><collection>Telecommunications (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ProQuest Engineering Collection</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Military Database</collection><collection>Research Library</collection><collection>Science Database</collection><collection>Telecommunications Database</collection><collection>Engineering Database</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><jtitle>IEEE software</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Clune, T. L.</au><au>Rood, R. B.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Software Testing and Verification in Climate Model Development</atitle><jtitle>IEEE software</jtitle><stitle>S-M</stitle><date>2011-11-01</date><risdate>2011</risdate><volume>28</volume><issue>6</issue><spage>49</spage><epage>55</epage><pages>49-55</pages><issn>0740-7459</issn><eissn>1937-4194</eissn><coden>IESOEG</coden><abstract>Over the past 30 years, most climate models have grown from relatively simple representations of a few atmospheric processes to complex multidisciplinary systems. Computer infrastructure over that period has gone from punchcard mainframes to modern parallel clusters. Model implementations have become complex, brittle, and increasingly difficult to extend and maintain. Verification processes for model implementations rely almost exclusively on some combination of detailed analyses of output from full climate simulations and system-level regression tests. Besides being costly in terms of developer time and computing resources, these testing methodologies are limited in the types of defects they can detect, isolate, and diagnose. Mitigating these weaknesses of coarse-grained testing with finer-grained unit tests has been perceived as cumbersome and counterproductive. Recent advances in commercial software tools and methodologies have led to a renaissance of systematic fine-grained testing. This opens new possibilities for testing climate-modeling-software methodologies.</abstract><cop>Los Alamitos</cop><pub>IEEE</pub><doi>10.1109/MS.2011.117</doi><tpages>7</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0740-7459
ispartof IEEE software, 2011-11, Vol.28 (6), p.49-55
issn 0740-7459
1937-4194
language eng
recordid cdi_ieee_primary_5999647
source IEEE Electronic Library (IEL)
subjects Atmospheric measurements
Atmospheric modeling
Automation
Climate change
Computational modeling
Computer programming
Global warming
Infrastructure
Meteorology
Numerical models
program verification
Software development
Software engineering
Software reliability
testing and debugging
testing strategies
title Software Testing and Verification in Climate Model Development
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T10%3A21%3A29IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Software%20Testing%20and%20Verification%20in%20Climate%20Model%20Development&rft.jtitle=IEEE%20software&rft.au=Clune,%20T.%20L.&rft.date=2011-11-01&rft.volume=28&rft.issue=6&rft.spage=49&rft.epage=55&rft.pages=49-55&rft.issn=0740-7459&rft.eissn=1937-4194&rft.coden=IESOEG&rft_id=info:doi/10.1109/MS.2011.117&rft_dat=%3Cproquest_RIE%3E2488643891%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=898841680&rft_id=info:pmid/&rft_ieee_id=5999647&rfr_iscdi=true