Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients

Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2023-10
Hauptverfasser: Huet-Dastarac, Margerie, Nguyen, Dan, Jiang, Steve, Lee, John, Ana Barragan Montero
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Huet-Dastarac, Margerie
Nguyen, Dan
Jiang, Steve
Lee, John
Ana Barragan Montero
description Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.
format Article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2884478633</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2884478633</sourcerecordid><originalsourceid>FETCH-proquest_journals_28844786333</originalsourceid><addsrcrecordid>eNqNjkFOAzEMRSMkJCroHSyxHmlIpu3sKlSBWLGCdZUmHpp26oTYWcyxuCEZ4ACsbPn7v_-v1EIb89D0ndY3asl8attWrzd6tTIL9bWzBIFSEcjoIrHk4iREggNCYfQgEXyomowTIEu4WKkKOcxiA8kEcQBbzR8ZmWfje_OKApfocdxC08BjSmNw9gdaYSlHmbcjZpsm8JGx3tCH39ghZjii9WDJA6E7g7NzGKRKQBK-U9eDHRmXf_NW3T8_ve1emgr-LLXh_hRLpirtdd933aZfG2P-9_UN1_xjDg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2884478633</pqid></control><display><type>article</type><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><source>Free E- Journals</source><creator>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</creator><creatorcontrib>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</creatorcontrib><description>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Cancer ; Correlation coefficients ; Estimation ; Head &amp; neck cancer ; Inference ; Protons ; Radiation therapy ; Reconstruction ; Regression models ; Safety critical ; Uncertainty</subject><ispartof>arXiv.org, 2023-10</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>776,780</link.rule.ids></links><search><creatorcontrib>Huet-Dastarac, Margerie</creatorcontrib><creatorcontrib>Nguyen, Dan</creatorcontrib><creatorcontrib>Jiang, Steve</creatorcontrib><creatorcontrib>Lee, John</creatorcontrib><creatorcontrib>Ana Barragan Montero</creatorcontrib><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><title>arXiv.org</title><description>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</description><subject>Cancer</subject><subject>Correlation coefficients</subject><subject>Estimation</subject><subject>Head &amp; neck cancer</subject><subject>Inference</subject><subject>Protons</subject><subject>Radiation therapy</subject><subject>Reconstruction</subject><subject>Regression models</subject><subject>Safety critical</subject><subject>Uncertainty</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNqNjkFOAzEMRSMkJCroHSyxHmlIpu3sKlSBWLGCdZUmHpp26oTYWcyxuCEZ4ACsbPn7v_-v1EIb89D0ndY3asl8attWrzd6tTIL9bWzBIFSEcjoIrHk4iREggNCYfQgEXyomowTIEu4WKkKOcxiA8kEcQBbzR8ZmWfje_OKApfocdxC08BjSmNw9gdaYSlHmbcjZpsm8JGx3tCH39ghZjii9WDJA6E7g7NzGKRKQBK-U9eDHRmXf_NW3T8_ve1emgr-LLXh_hRLpirtdd933aZfG2P-9_UN1_xjDg</recordid><startdate>20231030</startdate><enddate>20231030</enddate><creator>Huet-Dastarac, Margerie</creator><creator>Nguyen, Dan</creator><creator>Jiang, Steve</creator><creator>Lee, John</creator><creator>Ana Barragan Montero</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20231030</creationdate><title>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</title><author>Huet-Dastarac, Margerie ; Nguyen, Dan ; Jiang, Steve ; Lee, John ; Ana Barragan Montero</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_28844786333</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Cancer</topic><topic>Correlation coefficients</topic><topic>Estimation</topic><topic>Head &amp; neck cancer</topic><topic>Inference</topic><topic>Protons</topic><topic>Radiation therapy</topic><topic>Reconstruction</topic><topic>Regression models</topic><topic>Safety critical</topic><topic>Uncertainty</topic><toplevel>online_resources</toplevel><creatorcontrib>Huet-Dastarac, Margerie</creatorcontrib><creatorcontrib>Nguyen, Dan</creatorcontrib><creatorcontrib>Jiang, Steve</creatorcontrib><creatorcontrib>Lee, John</creatorcontrib><creatorcontrib>Ana Barragan Montero</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Huet-Dastarac, Margerie</au><au>Nguyen, Dan</au><au>Jiang, Steve</au><au>Lee, John</au><au>Ana Barragan Montero</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients</atitle><jtitle>arXiv.org</jtitle><date>2023-10-30</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Estimating the uncertainty of deep learning models in a reliable and efficient way has remained an open problem, where many different solutions have been proposed in the literature. Most common methods are based on Bayesian approximations, like Monte Carlo dropout (MCDO) or Deep ensembling (DE), but they have a high inference time (i.e. require multiple inference passes) and might not work for out-of-distribution detection (OOD) data (i.e. similar uncertainty for in-distribution (ID) and OOD). In safety critical environments, like medical applications, accurate and fast uncertainty estimation methods, able to detect OOD data, are crucial, since wrong predictions can jeopardize patients safety. In this study, we present an alternative direct uncertainty estimation method and apply it for a regression U-Net architecture. The method consists in the addition of a branch from the bottleneck which reconstructs the input. The input reconstruction error can be used as a surrogate of the model uncertainty. For the proof-of-concept, our method is applied to proton therapy dose prediction in head and neck cancer patients. Accuracy, time-gain, and OOD detection are analyzed for our method in this particular application and compared with the popular MCDO and DE. The input reconstruction method showed a higher Pearson correlation coefficient with the prediction error (0.620) than DE and MCDO (between 0.447 and 0.612). Moreover, our method allows an easier identification of OOD (Z-score of 34.05). It estimates the uncertainty simultaneously to the regression task, therefore requires less time or computational resources.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2023-10
issn 2331-8422
language eng
recordid cdi_proquest_journals_2884478633
source Free E- Journals
subjects Cancer
Correlation coefficients
Estimation
Head & neck cancer
Inference
Protons
Radiation therapy
Reconstruction
Regression models
Safety critical
Uncertainty
title Can input reconstruction be used to directly estimate uncertainty of a regression U-Net model? -- Application to proton therapy dose prediction for head and neck cancer patients
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T16%3A30%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Can%20input%20reconstruction%20be%20used%20to%20directly%20estimate%20uncertainty%20of%20a%20regression%20U-Net%20model?%20--%20Application%20to%20proton%20therapy%20dose%20prediction%20for%20head%20and%20neck%20cancer%20patients&rft.jtitle=arXiv.org&rft.au=Huet-Dastarac,%20Margerie&rft.date=2023-10-30&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2884478633%3C/proquest%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2884478633&rft_id=info:pmid/&rfr_iscdi=true