A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study

•The performance of existing prediction models for immune-related cardiac adverse reactions is relatively low, and there is no graded prediction model for these reactions.•This study presents a novel two-stage ensemble machine-learning strategy for predicting and grading immune-related cardiac adver...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computer methods and programs in biomedicine 2024-10, Vol.255, p.108360, Article 108360
Hauptverfasser: Cheng, Xitong, Wu, Zhaochun, Lin, Jierong, Wang, Bitao, Huang, Shunming, Liu, Maobai, Yang, Jing
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 108360
container_title Computer methods and programs in biomedicine
container_volume 255
creator Cheng, Xitong
Wu, Zhaochun
Lin, Jierong
Wang, Bitao
Huang, Shunming
Liu, Maobai
Yang, Jing
description •The performance of existing prediction models for immune-related cardiac adverse reactions is relatively low, and there is no graded prediction model for these reactions.•This study presents a novel two-stage ensemble machine-learning strategy for predicting and grading immune-related cardiac adverse reactions. The proposed method demonstrates good performance.•The two-stage ensemble learning model for predicting and grading immune-related cardiac adverse reactions holds potential clinical application value in preventing and treating patients. Immune-related cardiac adverse events (ircAEs) caused by programmed cell death protein-1 (PD-1) and programmed death-ligand-1 (PD-L1) inhibitors can lead to fulminant and even fatal consequences. This study aims to develop a prediction and grading model for ircAEs, enabling graded management of patients. This study utilized medical record systems from two medical institutions to develop a prediction and grading model for ircAEs using ten machine learning algorithms and two variable screening methods. The model was developed based on a two-stage ensemble learning framework. In the first stage, the ircAEs and non-ircAEs cases were classified. In the second stage, ircAEs cases were grouped into grades 1–2 and 3–5. The experiments were evaluated using five-fold cross-validation. The model's prediction performance was assessed using accuracy, precision, recall, F1 value, Brier score, receiver operating characteristic curve area (AUC), and area under the precision-recall curve (AUPR). 615 patients were included in the study. 147 experienced ircAEs, and 44 experienced grade 3–5 ircAEs. The soft voting classifier trained using the variables screened by feature importance ranking performed better than other classifiers in both stages. The average AUC for the first and second stages is 84.18 % and 85.13 %, respectively. In the first stage, the three most important variables are N-terminal B-type natriuretic peptide (NT-proBNP), interleukin-2 (IL-2), and C-reactive protein (CRP). In the second stage, the patient's age, NT-proBNP, and left ventricular ejection fraction (LVEF) are the three most critical variables. The prediction and grading model of ircAEs based on two-stage ensemble learning established in this study has good performance and potential clinical application.
doi_str_mv 10.1016/j.cmpb.2024.108360
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_3095175054</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0169260724003535</els_id><sourcerecordid>3095175054</sourcerecordid><originalsourceid>FETCH-LOGICAL-c237t-f209ab32f8310e6180e123449399361e7880c1ee7e6c22c784689abf08094c1f3</originalsourceid><addsrcrecordid>eNp9kc2OFCEUhYnROD2jL-DCsHRTPfxUAWXcdEYdTTrRha4JBbdaOlVQAtVmnsWXlU6PLt1AuHznXLgHoVeUbCmh4va4tfMybBlhbS0oLsgTtKFKskZ2onuKNhXqGyaIvELXOR8JIazrxHN0xXsquFTdBv3e4fIrNrmYA2AIGeZhAjyBScGHAx5MBoeXBM7b4mPAJjh8SMadL-foYMJjTPjr-4be1mVPsQ8__OBLTE2CyZSqtiY5byw27gQp1y4nCCW_xTs8r1Pxtp4g4QQlxbxAbXMCnMvqHl6gZ6OZMrx83G_Q948fvt19avZf7j_f7faNZVyWZmSkNwNno-KUgKCKAGW8bXve91xQkEoRSwEkCMuYlaoVqgpGokjfWjryG_Tm4ruk-HOFXPTss4VpMgHimjUnfUdlR7q2ouyC2vrYnGDUS_KzSQ-aEn0ORR_1ORR9DkVfQqmi14_-6zCD-yf5m0IF3l0AqL88eUg6Ww_B1qmnOhDtov-f_x-eU55Y</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3095175054</pqid></control><display><type>article</type><title>A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study</title><source>MEDLINE</source><source>Access via ScienceDirect (Elsevier)</source><creator>Cheng, Xitong ; Wu, Zhaochun ; Lin, Jierong ; Wang, Bitao ; Huang, Shunming ; Liu, Maobai ; Yang, Jing</creator><creatorcontrib>Cheng, Xitong ; Wu, Zhaochun ; Lin, Jierong ; Wang, Bitao ; Huang, Shunming ; Liu, Maobai ; Yang, Jing</creatorcontrib><description>•The performance of existing prediction models for immune-related cardiac adverse reactions is relatively low, and there is no graded prediction model for these reactions.•This study presents a novel two-stage ensemble machine-learning strategy for predicting and grading immune-related cardiac adverse reactions. The proposed method demonstrates good performance.•The two-stage ensemble learning model for predicting and grading immune-related cardiac adverse reactions holds potential clinical application value in preventing and treating patients. Immune-related cardiac adverse events (ircAEs) caused by programmed cell death protein-1 (PD-1) and programmed death-ligand-1 (PD-L1) inhibitors can lead to fulminant and even fatal consequences. This study aims to develop a prediction and grading model for ircAEs, enabling graded management of patients. This study utilized medical record systems from two medical institutions to develop a prediction and grading model for ircAEs using ten machine learning algorithms and two variable screening methods. The model was developed based on a two-stage ensemble learning framework. In the first stage, the ircAEs and non-ircAEs cases were classified. In the second stage, ircAEs cases were grouped into grades 1–2 and 3–5. The experiments were evaluated using five-fold cross-validation. The model's prediction performance was assessed using accuracy, precision, recall, F1 value, Brier score, receiver operating characteristic curve area (AUC), and area under the precision-recall curve (AUPR). 615 patients were included in the study. 147 experienced ircAEs, and 44 experienced grade 3–5 ircAEs. The soft voting classifier trained using the variables screened by feature importance ranking performed better than other classifiers in both stages. The average AUC for the first and second stages is 84.18 % and 85.13 %, respectively. In the first stage, the three most important variables are N-terminal B-type natriuretic peptide (NT-proBNP), interleukin-2 (IL-2), and C-reactive protein (CRP). In the second stage, the patient's age, NT-proBNP, and left ventricular ejection fraction (LVEF) are the three most critical variables. The prediction and grading model of ircAEs based on two-stage ensemble learning established in this study has good performance and potential clinical application.</description><identifier>ISSN: 0169-2607</identifier><identifier>ISSN: 1872-7565</identifier><identifier>EISSN: 1872-7565</identifier><identifier>DOI: 10.1016/j.cmpb.2024.108360</identifier><identifier>PMID: 39163785</identifier><language>eng</language><publisher>Ireland: Elsevier B.V</publisher><subject>Aged ; Algorithms ; B7-H1 Antigen - antagonists &amp; inhibitors ; Cardiac adverse events ; Female ; Grading prediction ; Humans ; Immune Checkpoint Inhibitors - adverse effects ; Immunotherapy ; Machine Learning ; Male ; Middle Aged ; Natriuretic Peptide, Brain - blood ; PD-1/PD-L1 inhibitors ; Peptide Fragments ; Programmed Cell Death 1 Receptor - antagonists &amp; inhibitors ; Retrospective Studies ; ROC Curve</subject><ispartof>Computer methods and programs in biomedicine, 2024-10, Vol.255, p.108360, Article 108360</ispartof><rights>2024</rights><rights>Copyright © 2024. Published by Elsevier B.V.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c237t-f209ab32f8310e6180e123449399361e7880c1ee7e6c22c784689abf08094c1f3</cites><orcidid>0009-0002-2228-5521 ; 0009-0005-9938-882X ; 0000-0002-1454-0791</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.cmpb.2024.108360$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>315,781,785,3551,27928,27929,45999</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/39163785$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Cheng, Xitong</creatorcontrib><creatorcontrib>Wu, Zhaochun</creatorcontrib><creatorcontrib>Lin, Jierong</creatorcontrib><creatorcontrib>Wang, Bitao</creatorcontrib><creatorcontrib>Huang, Shunming</creatorcontrib><creatorcontrib>Liu, Maobai</creatorcontrib><creatorcontrib>Yang, Jing</creatorcontrib><title>A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study</title><title>Computer methods and programs in biomedicine</title><addtitle>Comput Methods Programs Biomed</addtitle><description>•The performance of existing prediction models for immune-related cardiac adverse reactions is relatively low, and there is no graded prediction model for these reactions.•This study presents a novel two-stage ensemble machine-learning strategy for predicting and grading immune-related cardiac adverse reactions. The proposed method demonstrates good performance.•The two-stage ensemble learning model for predicting and grading immune-related cardiac adverse reactions holds potential clinical application value in preventing and treating patients. Immune-related cardiac adverse events (ircAEs) caused by programmed cell death protein-1 (PD-1) and programmed death-ligand-1 (PD-L1) inhibitors can lead to fulminant and even fatal consequences. This study aims to develop a prediction and grading model for ircAEs, enabling graded management of patients. This study utilized medical record systems from two medical institutions to develop a prediction and grading model for ircAEs using ten machine learning algorithms and two variable screening methods. The model was developed based on a two-stage ensemble learning framework. In the first stage, the ircAEs and non-ircAEs cases were classified. In the second stage, ircAEs cases were grouped into grades 1–2 and 3–5. The experiments were evaluated using five-fold cross-validation. The model's prediction performance was assessed using accuracy, precision, recall, F1 value, Brier score, receiver operating characteristic curve area (AUC), and area under the precision-recall curve (AUPR). 615 patients were included in the study. 147 experienced ircAEs, and 44 experienced grade 3–5 ircAEs. The soft voting classifier trained using the variables screened by feature importance ranking performed better than other classifiers in both stages. The average AUC for the first and second stages is 84.18 % and 85.13 %, respectively. In the first stage, the three most important variables are N-terminal B-type natriuretic peptide (NT-proBNP), interleukin-2 (IL-2), and C-reactive protein (CRP). In the second stage, the patient's age, NT-proBNP, and left ventricular ejection fraction (LVEF) are the three most critical variables. The prediction and grading model of ircAEs based on two-stage ensemble learning established in this study has good performance and potential clinical application.</description><subject>Aged</subject><subject>Algorithms</subject><subject>B7-H1 Antigen - antagonists &amp; inhibitors</subject><subject>Cardiac adverse events</subject><subject>Female</subject><subject>Grading prediction</subject><subject>Humans</subject><subject>Immune Checkpoint Inhibitors - adverse effects</subject><subject>Immunotherapy</subject><subject>Machine Learning</subject><subject>Male</subject><subject>Middle Aged</subject><subject>Natriuretic Peptide, Brain - blood</subject><subject>PD-1/PD-L1 inhibitors</subject><subject>Peptide Fragments</subject><subject>Programmed Cell Death 1 Receptor - antagonists &amp; inhibitors</subject><subject>Retrospective Studies</subject><subject>ROC Curve</subject><issn>0169-2607</issn><issn>1872-7565</issn><issn>1872-7565</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kc2OFCEUhYnROD2jL-DCsHRTPfxUAWXcdEYdTTrRha4JBbdaOlVQAtVmnsWXlU6PLt1AuHznXLgHoVeUbCmh4va4tfMybBlhbS0oLsgTtKFKskZ2onuKNhXqGyaIvELXOR8JIazrxHN0xXsquFTdBv3e4fIrNrmYA2AIGeZhAjyBScGHAx5MBoeXBM7b4mPAJjh8SMadL-foYMJjTPjr-4be1mVPsQ8__OBLTE2CyZSqtiY5byw27gQp1y4nCCW_xTs8r1Pxtp4g4QQlxbxAbXMCnMvqHl6gZ6OZMrx83G_Q948fvt19avZf7j_f7faNZVyWZmSkNwNno-KUgKCKAGW8bXve91xQkEoRSwEkCMuYlaoVqgpGokjfWjryG_Tm4ruk-HOFXPTss4VpMgHimjUnfUdlR7q2ouyC2vrYnGDUS_KzSQ-aEn0ORR_1ORR9DkVfQqmi14_-6zCD-yf5m0IF3l0AqL88eUg6Ww_B1qmnOhDtov-f_x-eU55Y</recordid><startdate>202410</startdate><enddate>202410</enddate><creator>Cheng, Xitong</creator><creator>Wu, Zhaochun</creator><creator>Lin, Jierong</creator><creator>Wang, Bitao</creator><creator>Huang, Shunming</creator><creator>Liu, Maobai</creator><creator>Yang, Jing</creator><general>Elsevier B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0009-0002-2228-5521</orcidid><orcidid>https://orcid.org/0009-0005-9938-882X</orcidid><orcidid>https://orcid.org/0000-0002-1454-0791</orcidid></search><sort><creationdate>202410</creationdate><title>A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study</title><author>Cheng, Xitong ; Wu, Zhaochun ; Lin, Jierong ; Wang, Bitao ; Huang, Shunming ; Liu, Maobai ; Yang, Jing</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c237t-f209ab32f8310e6180e123449399361e7880c1ee7e6c22c784689abf08094c1f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Aged</topic><topic>Algorithms</topic><topic>B7-H1 Antigen - antagonists &amp; inhibitors</topic><topic>Cardiac adverse events</topic><topic>Female</topic><topic>Grading prediction</topic><topic>Humans</topic><topic>Immune Checkpoint Inhibitors - adverse effects</topic><topic>Immunotherapy</topic><topic>Machine Learning</topic><topic>Male</topic><topic>Middle Aged</topic><topic>Natriuretic Peptide, Brain - blood</topic><topic>PD-1/PD-L1 inhibitors</topic><topic>Peptide Fragments</topic><topic>Programmed Cell Death 1 Receptor - antagonists &amp; inhibitors</topic><topic>Retrospective Studies</topic><topic>ROC Curve</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Cheng, Xitong</creatorcontrib><creatorcontrib>Wu, Zhaochun</creatorcontrib><creatorcontrib>Lin, Jierong</creatorcontrib><creatorcontrib>Wang, Bitao</creatorcontrib><creatorcontrib>Huang, Shunming</creatorcontrib><creatorcontrib>Liu, Maobai</creatorcontrib><creatorcontrib>Yang, Jing</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Computer methods and programs in biomedicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Cheng, Xitong</au><au>Wu, Zhaochun</au><au>Lin, Jierong</au><au>Wang, Bitao</au><au>Huang, Shunming</au><au>Liu, Maobai</au><au>Yang, Jing</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study</atitle><jtitle>Computer methods and programs in biomedicine</jtitle><addtitle>Comput Methods Programs Biomed</addtitle><date>2024-10</date><risdate>2024</risdate><volume>255</volume><spage>108360</spage><pages>108360-</pages><artnum>108360</artnum><issn>0169-2607</issn><issn>1872-7565</issn><eissn>1872-7565</eissn><abstract>•The performance of existing prediction models for immune-related cardiac adverse reactions is relatively low, and there is no graded prediction model for these reactions.•This study presents a novel two-stage ensemble machine-learning strategy for predicting and grading immune-related cardiac adverse reactions. The proposed method demonstrates good performance.•The two-stage ensemble learning model for predicting and grading immune-related cardiac adverse reactions holds potential clinical application value in preventing and treating patients. Immune-related cardiac adverse events (ircAEs) caused by programmed cell death protein-1 (PD-1) and programmed death-ligand-1 (PD-L1) inhibitors can lead to fulminant and even fatal consequences. This study aims to develop a prediction and grading model for ircAEs, enabling graded management of patients. This study utilized medical record systems from two medical institutions to develop a prediction and grading model for ircAEs using ten machine learning algorithms and two variable screening methods. The model was developed based on a two-stage ensemble learning framework. In the first stage, the ircAEs and non-ircAEs cases were classified. In the second stage, ircAEs cases were grouped into grades 1–2 and 3–5. The experiments were evaluated using five-fold cross-validation. The model's prediction performance was assessed using accuracy, precision, recall, F1 value, Brier score, receiver operating characteristic curve area (AUC), and area under the precision-recall curve (AUPR). 615 patients were included in the study. 147 experienced ircAEs, and 44 experienced grade 3–5 ircAEs. The soft voting classifier trained using the variables screened by feature importance ranking performed better than other classifiers in both stages. The average AUC for the first and second stages is 84.18 % and 85.13 %, respectively. In the first stage, the three most important variables are N-terminal B-type natriuretic peptide (NT-proBNP), interleukin-2 (IL-2), and C-reactive protein (CRP). In the second stage, the patient's age, NT-proBNP, and left ventricular ejection fraction (LVEF) are the three most critical variables. The prediction and grading model of ircAEs based on two-stage ensemble learning established in this study has good performance and potential clinical application.</abstract><cop>Ireland</cop><pub>Elsevier B.V</pub><pmid>39163785</pmid><doi>10.1016/j.cmpb.2024.108360</doi><orcidid>https://orcid.org/0009-0002-2228-5521</orcidid><orcidid>https://orcid.org/0009-0005-9938-882X</orcidid><orcidid>https://orcid.org/0000-0002-1454-0791</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0169-2607
ispartof Computer methods and programs in biomedicine, 2024-10, Vol.255, p.108360, Article 108360
issn 0169-2607
1872-7565
1872-7565
language eng
recordid cdi_proquest_miscellaneous_3095175054
source MEDLINE; Access via ScienceDirect (Elsevier)
subjects Aged
Algorithms
B7-H1 Antigen - antagonists & inhibitors
Cardiac adverse events
Female
Grading prediction
Humans
Immune Checkpoint Inhibitors - adverse effects
Immunotherapy
Machine Learning
Male
Middle Aged
Natriuretic Peptide, Brain - blood
PD-1/PD-L1 inhibitors
Peptide Fragments
Programmed Cell Death 1 Receptor - antagonists & inhibitors
Retrospective Studies
ROC Curve
title A two-stage ensemble learning based prediction and grading model for PD-1/PD-L1 inhibitor-related cardiac adverse events: A multicenter retrospective study
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-16T23%3A57%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20two-stage%20ensemble%20learning%20based%20prediction%20and%20grading%20model%20for%20PD-1/PD-L1%20inhibitor-related%20cardiac%20adverse%20events:%20A%20multicenter%20retrospective%20study&rft.jtitle=Computer%20methods%20and%20programs%20in%20biomedicine&rft.au=Cheng,%20Xitong&rft.date=2024-10&rft.volume=255&rft.spage=108360&rft.pages=108360-&rft.artnum=108360&rft.issn=0169-2607&rft.eissn=1872-7565&rft_id=info:doi/10.1016/j.cmpb.2024.108360&rft_dat=%3Cproquest_cross%3E3095175054%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3095175054&rft_id=info:pmid/39163785&rft_els_id=S0169260724003535&rfr_iscdi=true