Role of model parameterization in risk-based decision support: An empirical exploration

•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Advances in water resources 2019-06, Vol.128, p.59-73
Hauptverfasser: Knowling, Matthew J., White, Jeremy T., Moore, Catherine R.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 73
container_issue
container_start_page 59
container_title Advances in water resources
container_volume 128
creator Knowling, Matthew J.
White, Jeremy T.
Moore, Catherine R.
description •A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects. The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( > 2,000 adjustable parameters) display sig
doi_str_mv 10.1016/j.advwatres.2019.04.010
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2242110180</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0309170819300909</els_id><sourcerecordid>2242110180</sourcerecordid><originalsourceid>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</originalsourceid><addsrcrecordid>eNqFkFtLxDAQhYMouK7-BgM-t07StE19WxZvsCDIgo8hTaaQ2m1q0l0vv96uK776NDBzzhnOR8glg5QBK67bVNvdux4DxpQDq1IQKTA4IjMmS55URV4ekxlkUCWsBHlKzmJsAUCKks_Iy7PvkPqGbrzFjg466A2OGNyXHp3vqetpcPE1qXVESy0aF_fruB0GH8YbuugpbgYXnNEdxY-h8-HHeE5OGt1FvPidc7K-u10vH5LV0_3jcrFKTFbxMTE5sLywsspNJoVuhDYANZ-OUnCONTYyEwwhwyazRQm54UyYGuuSo6x5NidXh9gh-LctxlG1fhv66aPiXHA2EZIwqcqDygQfY8BGDcFtdPhUDNQeomrVH0S1h6hAqAni5FwcnDh12DkMKhqHvUHrAppRWe_-zfgGMwaATA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2242110180</pqid></control><display><type>article</type><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><source>Elsevier ScienceDirect Journals</source><creator>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</creator><creatorcontrib>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</creatorcontrib><description>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects. The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( &gt; 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( &gt; 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</description><identifier>ISSN: 0309-1708</identifier><identifier>EISSN: 1872-9657</identifier><identifier>DOI: 10.1016/j.advwatres.2019.04.010</identifier><language>eng</language><publisher>Oxford: Elsevier Ltd</publisher><subject>Bayesian analysis ; Bias ; Computer applications ; Computer simulation ; Conditional probability ; Decision analysis ; Decision making ; Decision support systems ; Empirical analysis ; Environment models ; Environmental model ; Environmental modeling ; Exploration ; Groundwater ; Heterogeneity ; History matching ; Inverse problem theory ; Inverse problems ; Management decisions ; Matching ; Mathematical models ; Model error ; Parameterization ; Parameters ; Plains ; Probability density functions ; Probability theory ; Questions ; Regional-scale models ; Resource management ; Risk management ; Scale models ; Stream discharge ; Stream flow ; Surface water ; Surface-groundwater relations ; Uncertainty ; Uncertainty quantification ; Water quality</subject><ispartof>Advances in water resources, 2019-06, Vol.128, p.59-73</ispartof><rights>2019 The Authors</rights><rights>Copyright Elsevier Science Ltd. Jun 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</citedby><cites>FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0309170819300909$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids></links><search><creatorcontrib>Knowling, Matthew J.</creatorcontrib><creatorcontrib>White, Jeremy T.</creatorcontrib><creatorcontrib>Moore, Catherine R.</creatorcontrib><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><title>Advances in water resources</title><description>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects. The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( &gt; 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( &gt; 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</description><subject>Bayesian analysis</subject><subject>Bias</subject><subject>Computer applications</subject><subject>Computer simulation</subject><subject>Conditional probability</subject><subject>Decision analysis</subject><subject>Decision making</subject><subject>Decision support systems</subject><subject>Empirical analysis</subject><subject>Environment models</subject><subject>Environmental model</subject><subject>Environmental modeling</subject><subject>Exploration</subject><subject>Groundwater</subject><subject>Heterogeneity</subject><subject>History matching</subject><subject>Inverse problem theory</subject><subject>Inverse problems</subject><subject>Management decisions</subject><subject>Matching</subject><subject>Mathematical models</subject><subject>Model error</subject><subject>Parameterization</subject><subject>Parameters</subject><subject>Plains</subject><subject>Probability density functions</subject><subject>Probability theory</subject><subject>Questions</subject><subject>Regional-scale models</subject><subject>Resource management</subject><subject>Risk management</subject><subject>Scale models</subject><subject>Stream discharge</subject><subject>Stream flow</subject><subject>Surface water</subject><subject>Surface-groundwater relations</subject><subject>Uncertainty</subject><subject>Uncertainty quantification</subject><subject>Water quality</subject><issn>0309-1708</issn><issn>1872-9657</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNqFkFtLxDAQhYMouK7-BgM-t07StE19WxZvsCDIgo8hTaaQ2m1q0l0vv96uK776NDBzzhnOR8glg5QBK67bVNvdux4DxpQDq1IQKTA4IjMmS55URV4ekxlkUCWsBHlKzmJsAUCKks_Iy7PvkPqGbrzFjg466A2OGNyXHp3vqetpcPE1qXVESy0aF_fruB0GH8YbuugpbgYXnNEdxY-h8-HHeE5OGt1FvPidc7K-u10vH5LV0_3jcrFKTFbxMTE5sLywsspNJoVuhDYANZ-OUnCONTYyEwwhwyazRQm54UyYGuuSo6x5NidXh9gh-LctxlG1fhv66aPiXHA2EZIwqcqDygQfY8BGDcFtdPhUDNQeomrVH0S1h6hAqAni5FwcnDh12DkMKhqHvUHrAppRWe_-zfgGMwaATA</recordid><startdate>201906</startdate><enddate>201906</enddate><creator>Knowling, Matthew J.</creator><creator>White, Jeremy T.</creator><creator>Moore, Catherine R.</creator><general>Elsevier Ltd</general><general>Elsevier Science Ltd</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QH</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SE</scope><scope>7SR</scope><scope>7ST</scope><scope>7T7</scope><scope>7TA</scope><scope>7TG</scope><scope>7UA</scope><scope>8BQ</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>F28</scope><scope>FR3</scope><scope>H8G</scope><scope>H97</scope><scope>JG9</scope><scope>KL.</scope><scope>KR7</scope><scope>L.G</scope><scope>P64</scope><scope>SOI</scope></search><sort><creationdate>201906</creationdate><title>Role of model parameterization in risk-based decision support: An empirical exploration</title><author>Knowling, Matthew J. ; White, Jeremy T. ; Moore, Catherine R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c392t-c50156d895c384af4ac00b2c398422ebef8341e03ef3d6705c214cbeb72e8b23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Bayesian analysis</topic><topic>Bias</topic><topic>Computer applications</topic><topic>Computer simulation</topic><topic>Conditional probability</topic><topic>Decision analysis</topic><topic>Decision making</topic><topic>Decision support systems</topic><topic>Empirical analysis</topic><topic>Environment models</topic><topic>Environmental model</topic><topic>Environmental modeling</topic><topic>Exploration</topic><topic>Groundwater</topic><topic>Heterogeneity</topic><topic>History matching</topic><topic>Inverse problem theory</topic><topic>Inverse problems</topic><topic>Management decisions</topic><topic>Matching</topic><topic>Mathematical models</topic><topic>Model error</topic><topic>Parameterization</topic><topic>Parameters</topic><topic>Plains</topic><topic>Probability density functions</topic><topic>Probability theory</topic><topic>Questions</topic><topic>Regional-scale models</topic><topic>Resource management</topic><topic>Risk management</topic><topic>Scale models</topic><topic>Stream discharge</topic><topic>Stream flow</topic><topic>Surface water</topic><topic>Surface-groundwater relations</topic><topic>Uncertainty</topic><topic>Uncertainty quantification</topic><topic>Water quality</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Knowling, Matthew J.</creatorcontrib><creatorcontrib>White, Jeremy T.</creatorcontrib><creatorcontrib>Moore, Catherine R.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Aqualine</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Environment Abstracts</collection><collection>Industrial and Applied Microbiology Abstracts (Microbiology A)</collection><collection>Materials Business File</collection><collection>Meteorological &amp; Geoastrophysical Abstracts</collection><collection>Water Resources Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Copper Technical Reference Library</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 3: Aquatic Pollution &amp; Environmental Quality</collection><collection>Materials Research Database</collection><collection>Meteorological &amp; Geoastrophysical Abstracts - Academic</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environment Abstracts</collection><jtitle>Advances in water resources</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Knowling, Matthew J.</au><au>White, Jeremy T.</au><au>Moore, Catherine R.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Role of model parameterization in risk-based decision support: An empirical exploration</atitle><jtitle>Advances in water resources</jtitle><date>2019-06</date><risdate>2019</risdate><volume>128</volume><spage>59</spage><epage>73</epage><pages>59-73</pages><issn>0309-1708</issn><eissn>1872-9657</eissn><abstract>•A Bayesian paired model and decision analysis approach is adopted.•Two case studies empirically demonstrate the potential damage caused by history matching models with reduced parameterization schemes.•Even “highly parameterized” schemes may suffer from ill-effects such as bias.•Ill-effects may be mitigated by adopting a prior uncertainty stance (i.e., by avoiding “calibration”).•Differencing simulated outputs of spatially-integrated nature may also provide protection against these ill-effects. The degree with which to parameterize a computer model that is to be used for risk-based resource management decision support has been a topic of much discussion in the environmental modeling industry, and remains a difficult choice facing practitioners. High-dimensional parameterization schemes allow for a more robust expression of model input uncertainty over traditional lower-dimensional schemes, but often incur a higher computational burden and require greater understanding of inverse problem theory to implement effectively. However, a number of significant questions remain, such as: “What level of parameterization is needed to adequately express uncertainty for a given decision-relevant simulated output?”; and “To what extent can a simplified parameterization be adopted while maintaining the ability of the model to serve as a decision-support tool?”. This study addresses these questions, among others, by using empirical paired complex-simple model analyses to investigate the consequences of reduced parameterization on decision-relevant simulated outputs in terms of bias incursion and underestimation of uncertainty. A Bayesian decision analysis approach is adopted to facilitate evaluation of parameterization reduction outcomes, not only in terms of the prior and posterior probability density functions of decision-relevant simulated outputs, but also in terms of the management decisions that would be made on their basis. Two integrated surface water/groundwater model case study examples are presented; the first is a complex synthetic model used to forecast groundwater abstraction-induced changes in ecologically-sensitive streamflow characteristics, and the second is a real-world regional-scale model (Hauraki Plains, New Zealand) used to simulate nitrate-loading impacts on water quality. It is shown empirically that, for some decision-relevant simulated outputs, even relatively high-dimensional parameterization schemes ( &gt; 2,000 adjustable parameters) display significant bias in simulated outputs as a result of improper parameter compensation induced through history matching, relative to complex parameterization schemes ( &gt; 100,000 adjustable parameters)—ultimately leading to incorrect decisions and resource management action. For other decision-relevant simulated outputs, however, reduced parameterization schemes may be appropriate for resource management decision making, especially when considering a prior uncertainty stance (i.e., without undertaking history matching) and when considering differences between simulated outputs that do not depend on local-scale heterogeneity.</abstract><cop>Oxford</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.advwatres.2019.04.010</doi><tpages>15</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0309-1708
ispartof Advances in water resources, 2019-06, Vol.128, p.59-73
issn 0309-1708
1872-9657
language eng
recordid cdi_proquest_journals_2242110180
source Elsevier ScienceDirect Journals
subjects Bayesian analysis
Bias
Computer applications
Computer simulation
Conditional probability
Decision analysis
Decision making
Decision support systems
Empirical analysis
Environment models
Environmental model
Environmental modeling
Exploration
Groundwater
Heterogeneity
History matching
Inverse problem theory
Inverse problems
Management decisions
Matching
Mathematical models
Model error
Parameterization
Parameters
Plains
Probability density functions
Probability theory
Questions
Regional-scale models
Resource management
Risk management
Scale models
Stream discharge
Stream flow
Surface water
Surface-groundwater relations
Uncertainty
Uncertainty quantification
Water quality
title Role of model parameterization in risk-based decision support: An empirical exploration
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T22%3A59%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Role%20of%20model%20parameterization%20in%20risk-based%20decision%20support:%20An%20empirical%20exploration&rft.jtitle=Advances%20in%20water%20resources&rft.au=Knowling,%20Matthew%20J.&rft.date=2019-06&rft.volume=128&rft.spage=59&rft.epage=73&rft.pages=59-73&rft.issn=0309-1708&rft.eissn=1872-9657&rft_id=info:doi/10.1016/j.advwatres.2019.04.010&rft_dat=%3Cproquest_cross%3E2242110180%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2242110180&rft_id=info:pmid/&rft_els_id=S0309170819300909&rfr_iscdi=true