Role of model parameterization in risk-based decision support: An empirical exploration
•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be...
Gespeichert in:
Veröffentlicht in: | Advances in water resources 2019-06, Vol.128, p.59-73 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 73 |
---|---|
container_issue | |
container_start_page | 59 |
container_title | Advances in water resources |
container_volume | 128 |
creator | Knowling, Matthew J. White, Jeremy T. Moore, Catherine R. |
description | •A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects.
The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( > 2,000 adjustable parameters) display sig |
doi_str_mv | 10.1016/j.advwatres.2019.04.010 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2242110180</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0309170819300909</els_id><sourcerecordid>2242110180</sourcerecordid><originalsourceid>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</originalsourceid><addsrcrecordid>eNqFkFtLxDAQhYMouK7-BgM-t07StE19WxZvsCDIgo8hTaaQ2m1q0l0vv96uK776NDBzzhnOR8glg5QBK67bVNvdux4DxpQDq1IQKTA4IjMmS55URV4ekxlkUCWsBHlKzmJsAUCKks_Iy7PvkPqGbrzFjg466A2OGNyXHp3vqetpcPE1qXVESy0aF_fruB0GH8YbuugpbgYXnNEdxY-h8-HHeE5OGt1FvPidc7K-u10vH5LV0_3jcrFKTFbxMTE5sLywsspNJoVuhDYANZ-OUnCONTYyEwwhwyazRQm54UyYGuuSo6x5NidXh9gh-LctxlG1fhv66aPiXHA2EZIwqcqDygQfY8BGDcFtdPhUDNQeomrVH0S1h6hAqAni5FwcnDh12DkMKhqHvUHrAppRWe_-zfgGMwaATA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2242110180</pqid></control><display><type>article</type><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><source>Elsevier ScienceDirect Journals</source><creator>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</creator><creatorcontrib>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</creatorcontrib><description>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects.
The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( > 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( > 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</description><identifier>ISSN: 0309-1708</identifier><identifier>EISSN: 1872-9657</identifier><identifier>DOI: 10.1016/j.advwatres.2019.04.010</identifier><language>eng</language><publisher>Oxford: Elsevier Ltd</publisher><subject>Bayesian analysis ; Bias ; Computer applications ; Computer simulation ; Conditional probability ; Decision analysis ; Decision making ; Decision support systems ; Empirical analysis ; Environment models ; Environmental model ; Environmental modeling ; Exploration ; Groundwater ; Heterogeneity ; History matching ; Inverse problem theory ; Inverse problems ; Management decisions ; Matching ; Mathematical models ; Model error ; Parameterization ; Parameters ; Plains ; Probability density functions ; Probability theory ; Questions ; Regional-scale models ; Resource management ; Risk management ; Scale models ; Stream discharge ; Stream flow ; Surface water ; Surface-groundwater relations ; Uncertainty ; Uncertainty quantification ; Water quality</subject><ispartof>Advances in water resources, 2019-06, Vol.128, p.59-73</ispartof><rights>2019 The Authors</rights><rights>Copyright Elsevier Science Ltd. Jun 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</citedby><cites>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0309170819300909$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids></links><search><creatorcontrib>Knowling, Matthew J.</creatorcontrib><creatorcontrib>White, Jeremy T.</creatorcontrib><creatorcontrib>Moore, Catherine R.</creatorcontrib><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><title>Advances in water resources</title><description>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects.
The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( > 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( > 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</description><subject>Bayesian analysis</subject><subject>Bias</subject><subject>Computer applications</subject><subject>Computer simulation</subject><subject>Conditional probability</subject><subject>Decision analysis</subject><subject>Decision making</subject><subject>Decision support systems</subject><subject>Empirical analysis</subject><subject>Environment models</subject><subject>Environmental model</subject><subject>Environmental modeling</subject><subject>Exploration</subject><subject>Groundwater</subject><subject>Heterogeneity</subject><subject>History matching</subject><subject>Inverse problem theory</subject><subject>Inverse problems</subject><subject>Management decisions</subject><subject>Matching</subject><subject>Mathematical models</subject><subject>Model error</subject><subject>Parameterization</subject><subject>Parameters</subject><subject>Plains</subject><subject>Probability density functions</subject><subject>Probability theory</subject><subject>Questions</subject><subject>Regional-scale models</subject><subject>Resource management</subject><subject>Risk management</subject><subject>Scale models</subject><subject>Stream discharge</subject><subject>Stream flow</subject><subject>Surface water</subject><subject>Surface-groundwater relations</subject><subject>Uncertainty</subject><subject>Uncertainty quantification</subject><subject>Water quality</subject><issn>0309-1708</issn><issn>1872-9657</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNqFkFtLxDAQhYMouK7-BgM-t07StE19WxZvsCDIgo8hTaaQ2m1q0l0vv96uK776NDBzzhnOR8glg5QBK67bVNvdux4DxpQDq1IQKTA4IjMmS55URV4ekxlkUCWsBHlKzmJsAUCKks_Iy7PvkPqGbrzFjg466A2OGNyXHp3vqetpcPE1qXVESy0aF_fruB0GH8YbuugpbgYXnNEdxY-h8-HHeE5OGt1FvPidc7K-u10vH5LV0_3jcrFKTFbxMTE5sLywsspNJoVuhDYANZ-OUnCONTYyEwwhwyazRQm54UyYGuuSo6x5NidXh9gh-LctxlG1fhv66aPiXHA2EZIwqcqDygQfY8BGDcFtdPhUDNQeomrVH0S1h6hAqAni5FwcnDh12DkMKhqHvUHrAppRWe_-zfgGMwaATA</recordid><startdate>201906</startdate><enddate>201906</enddate><creator>Knowling, Matthew J.</creator><creator>White, Jeremy T.</creator><creator>Moore, Catherine R.</creator><general>Elsevier Ltd</general><general>Elsevier Science Ltd</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QH</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SE</scope><scope>7SR</scope><scope>7ST</scope><scope>7T7</scope><scope>7TA</scope><scope>7TG</scope><scope>7UA</scope><scope>8BQ</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>F28</scope><scope>FR3</scope><scope>H8G</scope><scope>H97</scope><scope>JG9</scope><scope>KL.</scope><scope>KR7</scope><scope>L.G</scope><scope>P64</scope><scope>SOI</scope></search><sort><creationdate>201906</creationdate><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><author>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Bayesian analysis</topic><topic>Bias</topic><topic>Computer applications</topic><topic>Computer simulation</topic><topic>Conditional probability</topic><topic>Decision analysis</topic><topic>Decision making</topic><topic>Decision support systems</topic><topic>Empirical analysis</topic><topic>Environment models</topic><topic>Environmental model</topic><topic>Environmental modeling</topic><topic>Exploration</topic><topic>Groundwater</topic><topic>Heterogeneity</topic><topic>History matching</topic><topic>Inverse problem theory</topic><topic>Inverse problems</topic><topic>Management decisions</topic><topic>Matching</topic><topic>Mathematical models</topic><topic>Model error</topic><topic>Parameterization</topic><topic>Parameters</topic><topic>Plains</topic><topic>Probability density functions</topic><topic>Probability theory</topic><topic>Questions</topic><topic>Regional-scale models</topic><topic>Resource management</topic><topic>Risk management</topic><topic>Scale models</topic><topic>Stream discharge</topic><topic>Stream flow</topic><topic>Surface water</topic><topic>Surface-groundwater relations</topic><topic>Uncertainty</topic><topic>Uncertainty quantification</topic><topic>Water quality</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Knowling, Matthew J.</creatorcontrib><creatorcontrib>White, Jeremy T.</creatorcontrib><creatorcontrib>Moore, Catherine R.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Aqualine</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Environment Abstracts</collection><collection>Industrial and Applied Microbiology Abstracts (Microbiology A)</collection><collection>Materials Business File</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Water Resources Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Copper Technical Reference Library</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) 3: Aquatic Pollution & Environmental Quality</collection><collection>Materials Research Database</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) Professional</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environment Abstracts</collection><jtitle>Advances in water resources</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Knowling, Matthew J.</au><au>White, Jeremy T.</au><au>Moore, Catherine R.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Role of model parameterization in risk-based decision support: An empirical exploration</atitle><jtitle>Advances in water resources</jtitle><date>2019-06</date><risdate>2019</risdate><volume>128</volume><spage>59</spage><epage>73</epage><pages>59-73</pages><issn>0309-1708</issn><eissn>1872-9657</eissn><abstract>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects.
The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( > 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( > 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</abstract><cop>Oxford</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.advwatres.2019.04.010</doi><tpages>15</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0309-1708 |
ispartof | Advances in water resources, 2019-06, Vol.128, p.59-73 |
issn | 0309-1708 1872-9657 |
language | eng |
recordid | cdi_proquest_journals_2242110180 |
source | Elsevier ScienceDirect Journals |
subjects | Bayesian analysis Bias Computer applications Computer simulation Conditional probability Decision analysis Decision making Decision support systems Empirical analysis Environment models Environmental model Environmental modeling Exploration Groundwater Heterogeneity History matching Inverse problem theory Inverse problems Management decisions Matching Mathematical models Model error Parameterization Parameters Plains Probability density functions Probability theory Questions Regional-scale models Resource management Risk management Scale models Stream discharge Stream flow Surface water Surface-groundwater relations Uncertainty Uncertainty quantification Water quality |
title | Role of model parameterization in risk-based decision support: An empirical exploration |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T22%3A59%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Role%20of%20model%20parameterization%20in%20risk-based%20decision%20support:%20An%20empirical%20exploration&rft.jtitle=Advances%20in%20water%20resources&rft.au=Knowling,%20Matthew%20J.&rft.date=2019-06&rft.volume=128&rft.spage=59&rft.epage=73&rft.pages=59-73&rft.issn=0309-1708&rft.eissn=1872-9657&rft_id=info:doi/10.1016/j.advwatres.2019.04.010&rft_dat=%3Cproquest_cross%3E2242110180%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2242110180&rft_id=info:pmid/&rft_els_id=S0309170819300909&rfr_iscdi=true |