Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads
Core IdeasPTFs for water contents at specific pressure heads were developed.Covariate shift increased uncertainty in PTF predictions.Relative importance of predictors in machine learning PTFs was determined.There has been much effort to improve the performance of pedotransfer functions (PTFs) using...
Gespeichert in:
Veröffentlicht in: | Vadose zone journal 2019, Vol.18 (1) |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | 1 |
container_start_page | |
container_title | Vadose zone journal |
container_volume | 18 |
creator | Kotlar, Ali Mehmandoost de Jong van Lier, Quirijn Barros, Alexandre Hugo C. Iversen, Bo V. Vereecken, Harry |
description | Core IdeasPTFs for water contents at specific pressure heads were developed.Covariate shift increased uncertainty in PTF predictions.Relative importance of predictors in machine learning PTFs was determined.There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov–Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF‐predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty. |
doi_str_mv | 10.2136/vzj2019.06.0063 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2569357035</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2569357035</sourcerecordid><originalsourceid>FETCH-LOGICAL-c310t-511b4854ac8ce75f107ee135fcec45d74eb452ac19002ac462d830f2c6a51a5a3</originalsourceid><addsrcrecordid>eNpNkM1LAzEQxYMoWKtnrwHP2yabj-0eS7VWKFjQ4nFJsxPZ0iZrJluof71b68HTm-H9Zh48Qu45G-Vc6PHhe5szXo6YHjGmxQUZcCXKjGstLv_N1-QGcct6Usp8QI6PcIBdaPfgEzW-pmtvISbT-HSkU0RA_LWCoyuoQ4rGo4NI5523qQkeqQuRriLUTb_7T_phUm_Pgk_9GVKT6FsLtnGNPVGIXQS6AFPjLblyZodw96dDsp4_vc8W2fL1-WU2XWZWcJYyxflGTpQ0dmKhUI6zAoAL5SxYqepCwkaq3FheMtaL1Hk9EczlVhvFjTJiSB7Of9sYvjrAVG1DF30fWeVKl0IVTKieGp8pGwNiBFe1sdmbeKw4q079Vn_9VkxXp37FD5j6cHI</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2569357035</pqid></control><display><type>article</type><title>Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads</title><source>Wiley Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><source>Wiley Online Library (Open Access Collection)</source><creator>Kotlar, Ali Mehmandoost ; de Jong van Lier, Quirijn ; Barros, Alexandre Hugo C. ; Iversen, Bo V. ; Vereecken, Harry</creator><creatorcontrib>Kotlar, Ali Mehmandoost ; de Jong van Lier, Quirijn ; Barros, Alexandre Hugo C. ; Iversen, Bo V. ; Vereecken, Harry</creatorcontrib><description>Core IdeasPTFs for water contents at specific pressure heads were developed.Covariate shift increased uncertainty in PTF predictions.Relative importance of predictors in machine learning PTFs was determined.There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov–Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF‐predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.</description><identifier>ISSN: 1539-1663</identifier><identifier>EISSN: 1539-1663</identifier><identifier>DOI: 10.2136/vzj2019.06.0063</identifier><language>eng</language><publisher>Madison: John Wiley & Sons, Inc</publisher><subject>Algorithms ; Data ; Datasets ; Gaussian process ; Hydraulics ; Learning algorithms ; Machine learning ; Methods ; Moisture content ; Neural networks ; Parameters ; Particle size ; Predictions ; Pressure ; Pressure head ; Probability theory ; Regression analysis ; Regression models ; Soil ; Soil water ; Statistical analysis ; Testing ; Training ; Uncertainty ; Water content</subject><ispartof>Vadose zone journal, 2019, Vol.18 (1)</ispartof><rights>2019. This work is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c310t-511b4854ac8ce75f107ee135fcec45d74eb452ac19002ac462d830f2c6a51a5a3</citedby><cites>FETCH-LOGICAL-c310t-511b4854ac8ce75f107ee135fcec45d74eb452ac19002ac462d830f2c6a51a5a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,864,4024,27923,27924,27925</link.rule.ids></links><search><creatorcontrib>Kotlar, Ali Mehmandoost</creatorcontrib><creatorcontrib>de Jong van Lier, Quirijn</creatorcontrib><creatorcontrib>Barros, Alexandre Hugo C.</creatorcontrib><creatorcontrib>Iversen, Bo V.</creatorcontrib><creatorcontrib>Vereecken, Harry</creatorcontrib><title>Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads</title><title>Vadose zone journal</title><description>Core IdeasPTFs for water contents at specific pressure heads were developed.Covariate shift increased uncertainty in PTF predictions.Relative importance of predictors in machine learning PTFs was determined.There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov–Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF‐predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.</description><subject>Algorithms</subject><subject>Data</subject><subject>Datasets</subject><subject>Gaussian process</subject><subject>Hydraulics</subject><subject>Learning algorithms</subject><subject>Machine learning</subject><subject>Methods</subject><subject>Moisture content</subject><subject>Neural networks</subject><subject>Parameters</subject><subject>Particle size</subject><subject>Predictions</subject><subject>Pressure</subject><subject>Pressure head</subject><subject>Probability theory</subject><subject>Regression analysis</subject><subject>Regression models</subject><subject>Soil</subject><subject>Soil water</subject><subject>Statistical analysis</subject><subject>Testing</subject><subject>Training</subject><subject>Uncertainty</subject><subject>Water content</subject><issn>1539-1663</issn><issn>1539-1663</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNpNkM1LAzEQxYMoWKtnrwHP2yabj-0eS7VWKFjQ4nFJsxPZ0iZrJluof71b68HTm-H9Zh48Qu45G-Vc6PHhe5szXo6YHjGmxQUZcCXKjGstLv_N1-QGcct6Usp8QI6PcIBdaPfgEzW-pmtvISbT-HSkU0RA_LWCoyuoQ4rGo4NI5523qQkeqQuRriLUTb_7T_phUm_Pgk_9GVKT6FsLtnGNPVGIXQS6AFPjLblyZodw96dDsp4_vc8W2fL1-WU2XWZWcJYyxflGTpQ0dmKhUI6zAoAL5SxYqepCwkaq3FheMtaL1Hk9EczlVhvFjTJiSB7Of9sYvjrAVG1DF30fWeVKl0IVTKieGp8pGwNiBFe1sdmbeKw4q079Vn_9VkxXp37FD5j6cHI</recordid><startdate>2019</startdate><enddate>2019</enddate><creator>Kotlar, Ali Mehmandoost</creator><creator>de Jong van Lier, Quirijn</creator><creator>Barros, Alexandre Hugo C.</creator><creator>Iversen, Bo V.</creator><creator>Vereecken, Harry</creator><general>John Wiley & Sons, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>C1K</scope><scope>F1W</scope><scope>H96</scope><scope>L.G</scope></search><sort><creationdate>2019</creationdate><title>Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads</title><author>Kotlar, Ali Mehmandoost ; de Jong van Lier, Quirijn ; Barros, Alexandre Hugo C. ; Iversen, Bo V. ; Vereecken, Harry</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c310t-511b4854ac8ce75f107ee135fcec45d74eb452ac19002ac462d830f2c6a51a5a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Algorithms</topic><topic>Data</topic><topic>Datasets</topic><topic>Gaussian process</topic><topic>Hydraulics</topic><topic>Learning algorithms</topic><topic>Machine learning</topic><topic>Methods</topic><topic>Moisture content</topic><topic>Neural networks</topic><topic>Parameters</topic><topic>Particle size</topic><topic>Predictions</topic><topic>Pressure</topic><topic>Pressure head</topic><topic>Probability theory</topic><topic>Regression analysis</topic><topic>Regression models</topic><topic>Soil</topic><topic>Soil water</topic><topic>Statistical analysis</topic><topic>Testing</topic><topic>Training</topic><topic>Uncertainty</topic><topic>Water content</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kotlar, Ali Mehmandoost</creatorcontrib><creatorcontrib>de Jong van Lier, Quirijn</creatorcontrib><creatorcontrib>Barros, Alexandre Hugo C.</creatorcontrib><creatorcontrib>Iversen, Bo V.</creatorcontrib><creatorcontrib>Vereecken, Harry</creatorcontrib><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy & Non-Living Resources</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) Professional</collection><jtitle>Vadose zone journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kotlar, Ali Mehmandoost</au><au>de Jong van Lier, Quirijn</au><au>Barros, Alexandre Hugo C.</au><au>Iversen, Bo V.</au><au>Vereecken, Harry</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads</atitle><jtitle>Vadose zone journal</jtitle><date>2019</date><risdate>2019</risdate><volume>18</volume><issue>1</issue><issn>1539-1663</issn><eissn>1539-1663</eissn><abstract>Core IdeasPTFs for water contents at specific pressure heads were developed.Covariate shift increased uncertainty in PTF predictions.Relative importance of predictors in machine learning PTFs was determined.There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov–Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF‐predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.</abstract><cop>Madison</cop><pub>John Wiley & Sons, Inc</pub><doi>10.2136/vzj2019.06.0063</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1539-1663 |
ispartof | Vadose zone journal, 2019, Vol.18 (1) |
issn | 1539-1663 1539-1663 |
language | eng |
recordid | cdi_proquest_journals_2569357035 |
source | Wiley Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals; Wiley Online Library (Open Access Collection) |
subjects | Algorithms Data Datasets Gaussian process Hydraulics Learning algorithms Machine learning Methods Moisture content Neural networks Parameters Particle size Predictions Pressure Pressure head Probability theory Regression analysis Regression models Soil Soil water Statistical analysis Testing Training Uncertainty Water content |
title | Development and Uncertainty Assessment of Pedotransfer Functions for Predicting Water Contents at Specific Pressure Heads |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T06%3A28%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Development%20and%20Uncertainty%20Assessment%20of%20Pedotransfer%20Functions%20for%20Predicting%20Water%20Contents%20at%20Specific%20Pressure%20Heads&rft.jtitle=Vadose%20zone%20journal&rft.au=Kotlar,%20Ali%20Mehmandoost&rft.date=2019&rft.volume=18&rft.issue=1&rft.issn=1539-1663&rft.eissn=1539-1663&rft_id=info:doi/10.2136/vzj2019.06.0063&rft_dat=%3Cproquest_cross%3E2569357035%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2569357035&rft_id=info:pmid/&rfr_iscdi=true |