Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients
Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2023-10 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Huet-Dastarac, Margerie Nguyen, Dan Jiang, Steve Lee, John Ana Barragan Montero |
description | Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources. |
format | Article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2884478633</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2884478633</sourcerecordid><originalsourceid>FETCH-proquest_journals_28844786333</originalsourceid><addsrcrecordid>eNqNjkFOAzEMRSMkJCroHSyxHmlIpu3sKlSBWLGCdZUmHpp26oTYWcyxuCEZ4ACsbPn7v_-v1EIb89D0ndY3asl8attWrzd6tTIL9bWzBIFSEcjoIrHk4iREggNCYfQgEXyomowTIEu4WKkKOcxiA8kEcQBbzR8ZmWfje_OKApfocdxC08BjSmNw9gdaYSlHmbcjZpsm8JGx3tCH39ghZjii9WDJA6E7g7NzGKRKQBK-U9eDHRmXf_NW3T8_ve1emgr-LLXh_hRLpirtdd933aZfG2P-9_UN1_xjDg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2884478633</pqid></control><display><type>article</type><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><source>Free E- Journals</source><creator>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</creator><creatorcontrib>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</creatorcontrib><description>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Cancer ; Correlation coefficients ; Estimation ; Head & neck cancer ; Inference ; Protons ; Radiation therapy ; Reconstruction ; Regression models ; Safety critical ; Uncertainty</subject><ispartof>arXiv.org, 2023-10</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>776,780</link.rule.ids></links><search><creatorcontrib>Huet-Dastarac, Margerie</creatorcontrib><creatorcontrib>Nguyen, Dan</creatorcontrib><creatorcontrib>Jiang, Steve</creatorcontrib><creatorcontrib>Lee, John</creatorcontrib><creatorcontrib>Ana Barragan Montero</creatorcontrib><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><title>arXiv.org</title><description>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</description><subject>Cancer</subject><subject>Correlation coefficients</subject><subject>Estimation</subject><subject>Head & neck cancer</subject><subject>Inference</subject><subject>Protons</subject><subject>Radiation therapy</subject><subject>Reconstruction</subject><subject>Regression models</subject><subject>Safety critical</subject><subject>Uncertainty</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNqNjkFOAzEMRSMkJCroHSyxHmlIpu3sKlSBWLGCdZUmHpp26oTYWcyxuCEZ4ACsbPn7v_-v1EIb89D0ndY3asl8attWrzd6tTIL9bWzBIFSEcjoIrHk4iREggNCYfQgEXyomowTIEu4WKkKOcxiA8kEcQBbzR8ZmWfje_OKApfocdxC08BjSmNw9gdaYSlHmbcjZpsm8JGx3tCH39ghZjii9WDJA6E7g7NzGKRKQBK-U9eDHRmXf_NW3T8_ve1emgr-LLXh_hRLpirtdd933aZfG2P-9_UN1_xjDg</recordid><startdate>20231030</startdate><enddate>20231030</enddate><creator>Huet-Dastarac, Margerie</creator><creator>Nguyen, Dan</creator><creator>Jiang, Steve</creator><creator>Lee, John</creator><creator>Ana Barragan Montero</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20231030</creationdate><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><author>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28844786333</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Cancer</topic><topic>Correlation coefficients</topic><topic>Estimation</topic><topic>Head & neck cancer</topic><topic>Inference</topic><topic>Protons</topic><topic>Radiation therapy</topic><topic>Reconstruction</topic><topic>Regression models</topic><topic>Safety critical</topic><topic>Uncertainty</topic><toplevel>online_resources</toplevel><creatorcontrib>Huet-Dastarac, Margerie</creatorcontrib><creatorcontrib>Nguyen, Dan</creatorcontrib><creatorcontrib>Jiang, Steve</creatorcontrib><creatorcontrib>Lee, John</creatorcontrib><creatorcontrib>Ana Barragan Montero</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Huet-Dastarac, Margerie</au><au>Nguyen, Dan</au><au>Jiang, Steve</au><au>Lee, John</au><au>Ana Barragan Montero</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</atitle><jtitle>arXiv.org</jtitle><date>2023-10-30</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2023-10 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2884478633 |
source | Free E- Journals |
subjects | Cancer Correlation coefficients Estimation Head & neck cancer Inference Protons Radiation therapy Reconstruction Regression models Safety critical Uncertainty |
title | Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T16%3A30%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Can%20input%20reconstruction%20be%20used%20to%20directly%20estimate%20uncertainty%20of%20a%20regression%20U-Net%20model?%20--%20Application%20to%20proton%20therapy%20dose%20prediction%20for%20head%20and%20neck%20cancer%20patients&rft.jtitle=arXiv.org&rft.au=Huet-Dastarac,%20Margerie&rft.date=2023-10-30&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2884478633%3C/proquest%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2884478633&rft_id=info:pmid/&rfr_iscdi=true |