Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification
The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification....
Gespeichert in:
Veröffentlicht in: | Quantitative imaging in medicine and surgery 2023-01, Vol.13 (1), p.394-416 |
---|---|
Hauptverfasser: | , , , , , , , , , , , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 416 |
---|---|
container_issue | 1 |
container_start_page | 394 |
container_title | Quantitative imaging in medicine and surgery |
container_volume | 13 |
creator | Sun, Hongfei Ren, Ge Teng, Xinzhi Song, Liming Li, Kang Yang, Jianhua Hu, Xiaofei Zhan, Yuefu Wan, Shiu Bun Nelson Wong, Man Fung Esther Chan, King Kwong Tsang, Hoi Ching Hailey Xu, Lu Wu, Tak Chiu Kong, Feng-Ming Spring Wang, Yi Xiang J Qin, Jing Chan, Wing Chi Lawrence Ying, Michael Cai, Jing |
description | The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification.
Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models.
Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images.
The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods. |
doi_str_mv | 10.21037/qims-22-610 |
format | Article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_9816729</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2762821001</sourcerecordid><originalsourceid>FETCH-LOGICAL-c384t-25c486119b1070d0a66ede26c9e6a187c126b5ff6f8ac83feffda03351e417233</originalsourceid><addsrcrecordid>eNpVkU1PGzEURa2qqEHAruvKyy7q1u954pnZVEIp0EhIbAB1Zzme58TVfIDtIOXf1xCCijd-ko-ur30Y-wzyO4JU9Y_HMCSBKDTID-wYEZWolNQfDzO2OGNnKf2VZdUN1CA_sZnSGiVU-pj15zEHH1ywPQ9jpr4PaxodCZtSSJk6Pmz7XKZoM613PAx2TZzGjS3QQGPmk-duQynzPyLaXeJ-inxxc7_8JaDlrn_OKfk2h2k8ZUfe9onOXvcTdnd5cbv4La5vrpaL82vhVFNlgXNXNRqgXYGsZSet1tQRateSttDUDlCv5t5r31jXKE_ed1YqNQeqoEalTtjPfe7DdjVQ50rNaHvzEEv7uDOTDeb9yRg2Zj09mbYBXWNbAr6-BsTpcVseZ4aQXPkcO9K0TQZrjU0RIKGg3_aoi1NKkfzbNSDNiyPz7MggmuKo4F_-r_YGH4yofx3Mj2s</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2762821001</pqid></control><display><type>article</type><title>Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification</title><source>EZB-FREE-00999 freely available EZB journals</source><source>PubMed Central</source><creator>Sun, Hongfei ; Ren, Ge ; Teng, Xinzhi ; Song, Liming ; Li, Kang ; Yang, Jianhua ; Hu, Xiaofei ; Zhan, Yuefu ; Wan, Shiu Bun Nelson ; Wong, Man Fung Esther ; Chan, King Kwong ; Tsang, Hoi Ching Hailey ; Xu, Lu ; Wu, Tak Chiu ; Kong, Feng-Ming Spring ; Wang, Yi Xiang J ; Qin, Jing ; Chan, Wing Chi Lawrence ; Ying, Michael ; Cai, Jing</creator><creatorcontrib>Sun, Hongfei ; Ren, Ge ; Teng, Xinzhi ; Song, Liming ; Li, Kang ; Yang, Jianhua ; Hu, Xiaofei ; Zhan, Yuefu ; Wan, Shiu Bun Nelson ; Wong, Man Fung Esther ; Chan, King Kwong ; Tsang, Hoi Ching Hailey ; Xu, Lu ; Wu, Tak Chiu ; Kong, Feng-Ming Spring ; Wang, Yi Xiang J ; Qin, Jing ; Chan, Wing Chi Lawrence ; Ying, Michael ; Cai, Jing</creatorcontrib><description>The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification.
Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models.
Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images.
The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods.</description><identifier>ISSN: 2223-4292</identifier><identifier>EISSN: 2223-4306</identifier><identifier>DOI: 10.21037/qims-22-610</identifier><identifier>PMID: 36620146</identifier><language>eng</language><publisher>China: AME Publishing Company</publisher><subject>Original</subject><ispartof>Quantitative imaging in medicine and surgery, 2023-01, Vol.13 (1), p.394-416</ispartof><rights>2023 Quantitative Imaging in Medicine and Surgery. All rights reserved.</rights><rights>2023 Quantitative Imaging in Medicine and Surgery. All rights reserved. 2023 Quantitative Imaging in Medicine and Surgery.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c384t-25c486119b1070d0a66ede26c9e6a187c126b5ff6f8ac83feffda03351e417233</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9816729/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9816729/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,723,776,780,881,27903,27904,53770,53772</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/36620146$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Sun, Hongfei</creatorcontrib><creatorcontrib>Ren, Ge</creatorcontrib><creatorcontrib>Teng, Xinzhi</creatorcontrib><creatorcontrib>Song, Liming</creatorcontrib><creatorcontrib>Li, Kang</creatorcontrib><creatorcontrib>Yang, Jianhua</creatorcontrib><creatorcontrib>Hu, Xiaofei</creatorcontrib><creatorcontrib>Zhan, Yuefu</creatorcontrib><creatorcontrib>Wan, Shiu Bun Nelson</creatorcontrib><creatorcontrib>Wong, Man Fung Esther</creatorcontrib><creatorcontrib>Chan, King Kwong</creatorcontrib><creatorcontrib>Tsang, Hoi Ching Hailey</creatorcontrib><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Wu, Tak Chiu</creatorcontrib><creatorcontrib>Kong, Feng-Ming Spring</creatorcontrib><creatorcontrib>Wang, Yi Xiang J</creatorcontrib><creatorcontrib>Qin, Jing</creatorcontrib><creatorcontrib>Chan, Wing Chi Lawrence</creatorcontrib><creatorcontrib>Ying, Michael</creatorcontrib><creatorcontrib>Cai, Jing</creatorcontrib><title>Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification</title><title>Quantitative imaging in medicine and surgery</title><addtitle>Quant Imaging Med Surg</addtitle><description>The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification.
Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models.
Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images.
The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods.</description><subject>Original</subject><issn>2223-4292</issn><issn>2223-4306</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpVkU1PGzEURa2qqEHAruvKyy7q1u954pnZVEIp0EhIbAB1Zzme58TVfIDtIOXf1xCCijd-ko-ur30Y-wzyO4JU9Y_HMCSBKDTID-wYEZWolNQfDzO2OGNnKf2VZdUN1CA_sZnSGiVU-pj15zEHH1ywPQ9jpr4PaxodCZtSSJk6Pmz7XKZoM613PAx2TZzGjS3QQGPmk-duQynzPyLaXeJ-inxxc7_8JaDlrn_OKfk2h2k8ZUfe9onOXvcTdnd5cbv4La5vrpaL82vhVFNlgXNXNRqgXYGsZSet1tQRateSttDUDlCv5t5r31jXKE_ed1YqNQeqoEalTtjPfe7DdjVQ50rNaHvzEEv7uDOTDeb9yRg2Zj09mbYBXWNbAr6-BsTpcVseZ4aQXPkcO9K0TQZrjU0RIKGg3_aoi1NKkfzbNSDNiyPz7MggmuKo4F_-r_YGH4yofx3Mj2s</recordid><startdate>20230101</startdate><enddate>20230101</enddate><creator>Sun, Hongfei</creator><creator>Ren, Ge</creator><creator>Teng, Xinzhi</creator><creator>Song, Liming</creator><creator>Li, Kang</creator><creator>Yang, Jianhua</creator><creator>Hu, Xiaofei</creator><creator>Zhan, Yuefu</creator><creator>Wan, Shiu Bun Nelson</creator><creator>Wong, Man Fung Esther</creator><creator>Chan, King Kwong</creator><creator>Tsang, Hoi Ching Hailey</creator><creator>Xu, Lu</creator><creator>Wu, Tak Chiu</creator><creator>Kong, Feng-Ming Spring</creator><creator>Wang, Yi Xiang J</creator><creator>Qin, Jing</creator><creator>Chan, Wing Chi Lawrence</creator><creator>Ying, Michael</creator><creator>Cai, Jing</creator><general>AME Publishing Company</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20230101</creationdate><title>Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification</title><author>Sun, Hongfei ; Ren, Ge ; Teng, Xinzhi ; Song, Liming ; Li, Kang ; Yang, Jianhua ; Hu, Xiaofei ; Zhan, Yuefu ; Wan, Shiu Bun Nelson ; Wong, Man Fung Esther ; Chan, King Kwong ; Tsang, Hoi Ching Hailey ; Xu, Lu ; Wu, Tak Chiu ; Kong, Feng-Ming Spring ; Wang, Yi Xiang J ; Qin, Jing ; Chan, Wing Chi Lawrence ; Ying, Michael ; Cai, Jing</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c384t-25c486119b1070d0a66ede26c9e6a187c126b5ff6f8ac83feffda03351e417233</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Original</topic><toplevel>online_resources</toplevel><creatorcontrib>Sun, Hongfei</creatorcontrib><creatorcontrib>Ren, Ge</creatorcontrib><creatorcontrib>Teng, Xinzhi</creatorcontrib><creatorcontrib>Song, Liming</creatorcontrib><creatorcontrib>Li, Kang</creatorcontrib><creatorcontrib>Yang, Jianhua</creatorcontrib><creatorcontrib>Hu, Xiaofei</creatorcontrib><creatorcontrib>Zhan, Yuefu</creatorcontrib><creatorcontrib>Wan, Shiu Bun Nelson</creatorcontrib><creatorcontrib>Wong, Man Fung Esther</creatorcontrib><creatorcontrib>Chan, King Kwong</creatorcontrib><creatorcontrib>Tsang, Hoi Ching Hailey</creatorcontrib><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Wu, Tak Chiu</creatorcontrib><creatorcontrib>Kong, Feng-Ming Spring</creatorcontrib><creatorcontrib>Wang, Yi Xiang J</creatorcontrib><creatorcontrib>Qin, Jing</creatorcontrib><creatorcontrib>Chan, Wing Chi Lawrence</creatorcontrib><creatorcontrib>Ying, Michael</creatorcontrib><creatorcontrib>Cai, Jing</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Quantitative imaging in medicine and surgery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sun, Hongfei</au><au>Ren, Ge</au><au>Teng, Xinzhi</au><au>Song, Liming</au><au>Li, Kang</au><au>Yang, Jianhua</au><au>Hu, Xiaofei</au><au>Zhan, Yuefu</au><au>Wan, Shiu Bun Nelson</au><au>Wong, Man Fung Esther</au><au>Chan, King Kwong</au><au>Tsang, Hoi Ching Hailey</au><au>Xu, Lu</au><au>Wu, Tak Chiu</au><au>Kong, Feng-Ming Spring</au><au>Wang, Yi Xiang J</au><au>Qin, Jing</au><au>Chan, Wing Chi Lawrence</au><au>Ying, Michael</au><au>Cai, Jing</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification</atitle><jtitle>Quantitative imaging in medicine and surgery</jtitle><addtitle>Quant Imaging Med Surg</addtitle><date>2023-01-01</date><risdate>2023</risdate><volume>13</volume><issue>1</issue><spage>394</spage><epage>416</epage><pages>394-416</pages><issn>2223-4292</issn><eissn>2223-4306</eissn><abstract>The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification.
Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models.
Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images.
The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods.</abstract><cop>China</cop><pub>AME Publishing Company</pub><pmid>36620146</pmid><doi>10.21037/qims-22-610</doi><tpages>23</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2223-4292 |
ispartof | Quantitative imaging in medicine and surgery, 2023-01, Vol.13 (1), p.394-416 |
issn | 2223-4292 2223-4306 |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_9816729 |
source | EZB-FREE-00999 freely available EZB journals; PubMed Central |
subjects | Original |
title | Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T12%3A43%3A55IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Artificial%20intelligence-assisted%20multistrategy%20image%20enhancement%20of%20chest%20X-rays%20for%20COVID-19%20classification&rft.jtitle=Quantitative%20imaging%20in%20medicine%20and%20surgery&rft.au=Sun,%20Hongfei&rft.date=2023-01-01&rft.volume=13&rft.issue=1&rft.spage=394&rft.epage=416&rft.pages=394-416&rft.issn=2223-4292&rft.eissn=2223-4306&rft_id=info:doi/10.21037/qims-22-610&rft_dat=%3Cproquest_pubme%3E2762821001%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2762821001&rft_id=info:pmid/36620146&rfr_iscdi=true |