Challenges and Techniques for Reproducible Simulations
Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety...
Gespeichert in:
| Veröffentlicht in: | Computing in science & engineering 2023-07, Vol.25 (4), p.42-46 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 46 |
|---|---|
| container_issue | 4 |
| container_start_page | 42 |
| container_title | Computing in science & engineering |
| container_volume | 25 |
| creator | Muhlberger, Curran D. Schneider, Barry I. Wainer, Gabriel A. |
| description | Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster. |
| doi_str_mv | 10.1109/MCSE.2023.3322127 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_10438049</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10438049</ieee_id><sourcerecordid>2927607666</sourcerecordid><originalsourceid>FETCH-LOGICAL-c246t-6f0de18c5f47613307086c8eef08f358b6cf3c20bc530a35a906a4e56441f0663</originalsourceid><addsrcrecordid>eNpNkE9Lw0AQxRdRsFY_gOAh4Dl19t9kc5RQq1ARbAVvy3Y7a1PSpG6ag9_exPbgad7AezOPH2O3HCacQ_7wWiymEwFCTqQUgovsjI241iaViJ_ngxY8zZHrS3bVtlsAUCbXI4bFxlUV1V_UJq5eJ0vym7r87vo1NDF5p31s1p0vVxUli3LXVe5QNnV7zS6Cq1q6Oc0x-3iaLovndP42eyke56kXCg8pBlgTN14HlSGXEjIw6A1RABOkNiv0QXoBK68lOKldDugUaVSKB0CUY3Z_vNvXGEod7LbpYt2_tCIXGUKGfy5-dPnYtG2kYPex3Ln4YznYAY8d8NgBjz3h6TN3x0xJRP_8ShpQufwFVeNfwA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2927607666</pqid></control><display><type>article</type><title>Challenges and Techniques for Reproducible Simulations</title><source>IEEE Electronic Library (IEL)</source><creator>Muhlberger, Curran D. ; Schneider, Barry I. ; Wainer, Gabriel A.</creator><contributor>Barry I Schneider ; Gabriel A Wainer</contributor><creatorcontrib>Muhlberger, Curran D. ; Schneider, Barry I. ; Wainer, Gabriel A. ; Barry I Schneider ; Gabriel A Wainer</creatorcontrib><description>Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster.</description><identifier>ISSN: 1521-9615</identifier><identifier>EISSN: 1558-366X</identifier><identifier>DOI: 10.1109/MCSE.2023.3322127</identifier><identifier>CODEN: CSENFA</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Codes ; Computer networks ; Reproducibility ; Reproducibility of results ; Runtime ; Simulation ; Software engineering</subject><ispartof>Computing in science & engineering, 2023-07, Vol.25 (4), p.42-46</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c246t-6f0de18c5f47613307086c8eef08f358b6cf3c20bc530a35a906a4e56441f0663</cites><orcidid>0000-0002-2909-3242</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10438049$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10438049$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><contributor>Barry I Schneider</contributor><contributor>Gabriel A Wainer</contributor><creatorcontrib>Muhlberger, Curran D.</creatorcontrib><creatorcontrib>Schneider, Barry I.</creatorcontrib><creatorcontrib>Wainer, Gabriel A.</creatorcontrib><title>Challenges and Techniques for Reproducible Simulations</title><title>Computing in science & engineering</title><addtitle>CISE-M</addtitle><description>Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster.</description><subject>Codes</subject><subject>Computer networks</subject><subject>Reproducibility</subject><subject>Reproducibility of results</subject><subject>Runtime</subject><subject>Simulation</subject><subject>Software engineering</subject><issn>1521-9615</issn><issn>1558-366X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkE9Lw0AQxRdRsFY_gOAh4Dl19t9kc5RQq1ARbAVvy3Y7a1PSpG6ag9_exPbgad7AezOPH2O3HCacQ_7wWiymEwFCTqQUgovsjI241iaViJ_ngxY8zZHrS3bVtlsAUCbXI4bFxlUV1V_UJq5eJ0vym7r87vo1NDF5p31s1p0vVxUli3LXVe5QNnV7zS6Cq1q6Oc0x-3iaLovndP42eyke56kXCg8pBlgTN14HlSGXEjIw6A1RABOkNiv0QXoBK68lOKldDugUaVSKB0CUY3Z_vNvXGEod7LbpYt2_tCIXGUKGfy5-dPnYtG2kYPex3Ln4YznYAY8d8NgBjz3h6TN3x0xJRP_8ShpQufwFVeNfwA</recordid><startdate>202307</startdate><enddate>202307</enddate><creator>Muhlberger, Curran D.</creator><creator>Schneider, Barry I.</creator><creator>Wainer, Gabriel A.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2909-3242</orcidid></search><sort><creationdate>202307</creationdate><title>Challenges and Techniques for Reproducible Simulations</title><author>Muhlberger, Curran D. ; Schneider, Barry I. ; Wainer, Gabriel A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c246t-6f0de18c5f47613307086c8eef08f358b6cf3c20bc530a35a906a4e56441f0663</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Codes</topic><topic>Computer networks</topic><topic>Reproducibility</topic><topic>Reproducibility of results</topic><topic>Runtime</topic><topic>Simulation</topic><topic>Software engineering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Muhlberger, Curran D.</creatorcontrib><creatorcontrib>Schneider, Barry I.</creatorcontrib><creatorcontrib>Wainer, Gabriel A.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computing in science & engineering</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Muhlberger, Curran D.</au><au>Schneider, Barry I.</au><au>Wainer, Gabriel A.</au><au>Barry I Schneider</au><au>Gabriel A Wainer</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Challenges and Techniques for Reproducible Simulations</atitle><jtitle>Computing in science & engineering</jtitle><stitle>CISE-M</stitle><date>2023-07</date><risdate>2023</risdate><volume>25</volume><issue>4</issue><spage>42</spage><epage>46</epage><pages>42-46</pages><issn>1521-9615</issn><eissn>1558-366X</eissn><coden>CSENFA</coden><abstract>Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/MCSE.2023.3322127</doi><tpages>5</tpages><orcidid>https://orcid.org/0000-0002-2909-3242</orcidid></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1521-9615 |
| ispartof | Computing in science & engineering, 2023-07, Vol.25 (4), p.42-46 |
| issn | 1521-9615 1558-366X |
| language | eng |
| recordid | cdi_ieee_primary_10438049 |
| source | IEEE Electronic Library (IEL) |
| subjects | Codes Computer networks Reproducibility Reproducibility of results Runtime Simulation Software engineering |
| title | Challenges and Techniques for Reproducible Simulations |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T19%3A31%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Challenges%20and%20Techniques%20for%20Reproducible%20Simulations&rft.jtitle=Computing%20in%20science%20&%20engineering&rft.au=Muhlberger,%20Curran%20D.&rft.date=2023-07&rft.volume=25&rft.issue=4&rft.spage=42&rft.epage=46&rft.pages=42-46&rft.issn=1521-9615&rft.eissn=1558-366X&rft.coden=CSENFA&rft_id=info:doi/10.1109/MCSE.2023.3322127&rft_dat=%3Cproquest_RIE%3E2927607666%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2927607666&rft_id=info:pmid/&rft_ieee_id=10438049&rfr_iscdi=true |