Perfectly predicting ICU length of stay: too good to be true

A paper of Alsinglawi et al was recently accepted and published in Scientific Reports. In this paper, the authors aim to predict length of stay (LOS), discretized into either long (> 7 days) or short stays (< 7 days), of lung cancer patients in an ICU department using various machine learning...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ramachandra, Sandeep, Vandewiele, Gilles, Mijnsbrugge, David Vander, Ongenae, Femke, Van Hoecke, Sofie
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Ramachandra, Sandeep
Vandewiele, Gilles
Mijnsbrugge, David Vander
Ongenae, Femke
Van Hoecke, Sofie
description A paper of Alsinglawi et al was recently accepted and published in Scientific Reports. In this paper, the authors aim to predict length of stay (LOS), discretized into either long (> 7 days) or short stays (< 7 days), of lung cancer patients in an ICU department using various machine learning techniques. The authors claim to achieve perfect results with an Area Under the Receiver Operating Characteristic curve (AUROC) of 100% with a Random Forest (RF) classifier with ADASYN class balancing over sampling technique, which if accurate could have significant implications for hospital management. However, we have identified several methodological flaws within the manuscript which cause the results to be overly optimistic and would have serious consequences if used in a clinical practice. Moreover, the reporting of the methodology is unclear and many important details are missing from the manuscript, which makes reproduction extremely difficult. We highlight the effect these oversights have had on the result and provide a more believable result of 88.91% AUROC when these oversights are corrected.
doi_str_mv 10.48550/arxiv.2211.05597
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2211_05597</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2211_05597</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-e75f08b379209a01bd660422a55f0ba4880bc2446f31488f487ac13f9364cd773</originalsourceid><addsrcrecordid>eNotj7tOwzAYhb0woMIDMPG_QILvdhALirhUqgRDO0e_HTuNFOrKNYi8PaEwnctwdD5CbhitpVWK3mH-Hr9qzhmrqVKNuSQP7yHH4Ms0wzGHfvRlPAywbncwhcNQ9pAinArO91BSgiGlfjHgApT8Ga7IRcTpFK7_dUW2z0_b9rXavL2s28dNhdqYKhgVqXXCNJw2SJnrtaaSc1RL71BaS53nUuoo2BKitAY9E7ERWvreGLEit3-z5_vdMY8fmOfuF6M7Y4gfFyRAiw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Perfectly predicting ICU length of stay: too good to be true</title><source>arXiv.org</source><creator>Ramachandra, Sandeep ; Vandewiele, Gilles ; Mijnsbrugge, David Vander ; Ongenae, Femke ; Van Hoecke, Sofie</creator><creatorcontrib>Ramachandra, Sandeep ; Vandewiele, Gilles ; Mijnsbrugge, David Vander ; Ongenae, Femke ; Van Hoecke, Sofie</creatorcontrib><description>A paper of Alsinglawi et al was recently accepted and published in Scientific Reports. In this paper, the authors aim to predict length of stay (LOS), discretized into either long (&gt; 7 days) or short stays (&lt; 7 days), of lung cancer patients in an ICU department using various machine learning techniques. The authors claim to achieve perfect results with an Area Under the Receiver Operating Characteristic curve (AUROC) of 100% with a Random Forest (RF) classifier with ADASYN class balancing over sampling technique, which if accurate could have significant implications for hospital management. However, we have identified several methodological flaws within the manuscript which cause the results to be overly optimistic and would have serious consequences if used in a clinical practice. Moreover, the reporting of the methodology is unclear and many important details are missing from the manuscript, which makes reproduction extremely difficult. We highlight the effect these oversights have had on the result and provide a more believable result of 88.91% AUROC when these oversights are corrected.</description><identifier>DOI: 10.48550/arxiv.2211.05597</identifier><language>eng</language><subject>Computer Science - Learning ; Statistics - Methodology</subject><creationdate>2022-11</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2211.05597$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2211.05597$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Ramachandra, Sandeep</creatorcontrib><creatorcontrib>Vandewiele, Gilles</creatorcontrib><creatorcontrib>Mijnsbrugge, David Vander</creatorcontrib><creatorcontrib>Ongenae, Femke</creatorcontrib><creatorcontrib>Van Hoecke, Sofie</creatorcontrib><title>Perfectly predicting ICU length of stay: too good to be true</title><description>A paper of Alsinglawi et al was recently accepted and published in Scientific Reports. In this paper, the authors aim to predict length of stay (LOS), discretized into either long (&gt; 7 days) or short stays (&lt; 7 days), of lung cancer patients in an ICU department using various machine learning techniques. The authors claim to achieve perfect results with an Area Under the Receiver Operating Characteristic curve (AUROC) of 100% with a Random Forest (RF) classifier with ADASYN class balancing over sampling technique, which if accurate could have significant implications for hospital management. However, we have identified several methodological flaws within the manuscript which cause the results to be overly optimistic and would have serious consequences if used in a clinical practice. Moreover, the reporting of the methodology is unclear and many important details are missing from the manuscript, which makes reproduction extremely difficult. We highlight the effect these oversights have had on the result and provide a more believable result of 88.91% AUROC when these oversights are corrected.</description><subject>Computer Science - Learning</subject><subject>Statistics - Methodology</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj7tOwzAYhb0woMIDMPG_QILvdhALirhUqgRDO0e_HTuNFOrKNYi8PaEwnctwdD5CbhitpVWK3mH-Hr9qzhmrqVKNuSQP7yHH4Ms0wzGHfvRlPAywbncwhcNQ9pAinArO91BSgiGlfjHgApT8Ga7IRcTpFK7_dUW2z0_b9rXavL2s28dNhdqYKhgVqXXCNJw2SJnrtaaSc1RL71BaS53nUuoo2BKitAY9E7ERWvreGLEit3-z5_vdMY8fmOfuF6M7Y4gfFyRAiw</recordid><startdate>20221110</startdate><enddate>20221110</enddate><creator>Ramachandra, Sandeep</creator><creator>Vandewiele, Gilles</creator><creator>Mijnsbrugge, David Vander</creator><creator>Ongenae, Femke</creator><creator>Van Hoecke, Sofie</creator><scope>AKY</scope><scope>EPD</scope><scope>GOX</scope></search><sort><creationdate>20221110</creationdate><title>Perfectly predicting ICU length of stay: too good to be true</title><author>Ramachandra, Sandeep ; Vandewiele, Gilles ; Mijnsbrugge, David Vander ; Ongenae, Femke ; Van Hoecke, Sofie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-e75f08b379209a01bd660422a55f0ba4880bc2446f31488f487ac13f9364cd773</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Learning</topic><topic>Statistics - Methodology</topic><toplevel>online_resources</toplevel><creatorcontrib>Ramachandra, Sandeep</creatorcontrib><creatorcontrib>Vandewiele, Gilles</creatorcontrib><creatorcontrib>Mijnsbrugge, David Vander</creatorcontrib><creatorcontrib>Ongenae, Femke</creatorcontrib><creatorcontrib>Van Hoecke, Sofie</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv Statistics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ramachandra, Sandeep</au><au>Vandewiele, Gilles</au><au>Mijnsbrugge, David Vander</au><au>Ongenae, Femke</au><au>Van Hoecke, Sofie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Perfectly predicting ICU length of stay: too good to be true</atitle><date>2022-11-10</date><risdate>2022</risdate><abstract>A paper of Alsinglawi et al was recently accepted and published in Scientific Reports. In this paper, the authors aim to predict length of stay (LOS), discretized into either long (&gt; 7 days) or short stays (&lt; 7 days), of lung cancer patients in an ICU department using various machine learning techniques. The authors claim to achieve perfect results with an Area Under the Receiver Operating Characteristic curve (AUROC) of 100% with a Random Forest (RF) classifier with ADASYN class balancing over sampling technique, which if accurate could have significant implications for hospital management. However, we have identified several methodological flaws within the manuscript which cause the results to be overly optimistic and would have serious consequences if used in a clinical practice. Moreover, the reporting of the methodology is unclear and many important details are missing from the manuscript, which makes reproduction extremely difficult. We highlight the effect these oversights have had on the result and provide a more believable result of 88.91% AUROC when these oversights are corrected.</abstract><doi>10.48550/arxiv.2211.05597</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2211.05597
ispartof
issn
language eng
recordid cdi_arxiv_primary_2211_05597
source arXiv.org
subjects Computer Science - Learning
Statistics - Methodology
title Perfectly predicting ICU length of stay: too good to be true
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T01%3A34%3A59IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Perfectly%20predicting%20ICU%20length%20of%20stay:%20too%20good%20to%20be%20true&rft.au=Ramachandra,%20Sandeep&rft.date=2022-11-10&rft_id=info:doi/10.48550/arxiv.2211.05597&rft_dat=%3Carxiv_GOX%3E2211_05597%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true