COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework

•We propose a novel two-stage transfer learning framework for segmenting COVID-19 lung infections from CT images. Our framework learns valuable knowledge from both natural images and CT images with pulmonary nodules, allowing more effective network training for improved performance.•We propose an ef...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Medical image analysis 2021-12, Vol.74, p.102205-102205, Article 102205
Hauptverfasser: Liu, Jiannan, Dong, Bo, Wang, Shuai, Cui, Hui, Fan, Deng-Ping, Ma, Jiquan, Chen, Geng
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 102205
container_issue
container_start_page 102205
container_title Medical image analysis
container_volume 74
creator Liu, Jiannan
Dong, Bo
Wang, Shuai
Cui, Hui
Fan, Deng-Ping
Ma, Jiquan
Chen, Geng
description •We propose a novel two-stage transfer learning framework for segmenting COVID-19 lung infections from CT images. Our framework learns valuable knowledge from both natural images and CT images with pulmonary nodules, allowing more effective network training for improved performance.•We propose an effective infection segmentation network, called nCoVSegNet, which takes advantage of attention-aware feature fusion and large reception fields for accurate segmentation of lung infections.•Extensive experiments on two COVID-19 CT datasets demonstrate that our framework is able to segment lung infections accurately and outperforms state-of-the-art methods remarkably. [Display omitted] With the global outbreak of COVID-19 in early 2020, rapid diagnosis of COVID-19 has become the urgent need to control the spread of the epidemic. In clinical settings, lung infection segmentation from computed tomography (CT) images can provide vital information for the quantification and diagnosis of COVID-19. However, accurate infection segmentation is a challenging task due to (i) the low boundary contrast between infections and the surroundings, (ii) large variations of infection regions, and, most importantly, (iii) the shortage of large-scale annotated data. To address these issues, we propose a novel two-stage cross-domain transfer learning framework for the accurate segmentation of COVID-19 lung infections from CT images. Our framework consists of two major technical innovations, including an effective infection segmentation deep learning model, called nCoVSegNet, and a novel two-stage transfer learning strategy. Specifically, our nCoVSegNet conducts effective infection segmentation by taking advantage of attention-aware feature fusion and large receptive fields, aiming to resolve the issues related to low boundary contrast and large infection variations. To alleviate the shortage of the data, the nCoVSegNet is pre-trained using a two-stage cross-domain transfer learning strategy, which makes full use of the knowledge from natural images (i.e., ImageNet) and medical images (i.e., LIDC-IDRI) to boost the final training on CT images with COVID-19 infections. Extensive experiments demonstrate that our framework achieves superior segmentation accuracy and outperforms the cutting-edge models, both quantitatively and qualitatively.
doi_str_mv 10.1016/j.media.2021.102205
format Article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_8342869</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1361841521002504</els_id><sourcerecordid>2564130819</sourcerecordid><originalsourceid>FETCH-LOGICAL-c487t-f20f1a71ea89ea0d7c8a554c6e366bb076bfff50202c1c2de8c924c52a9102ad3</originalsourceid><addsrcrecordid>eNp9kUtvEzEUhS0EoqXwC5CQJTZsJvg1npkFSCgUqFSpG2Br3XiuU4cZu9gzifj3dZISAQtWfn33-J57CHnJ2YIzrt9uFiP2HhaCCV5uhGD1I3LOpeZVq4R8fNrz-ow8y3nDGGuUYk_JmVRK1JI356Rf3ny_-ljxjg5zWFMfHNrJx0AzrkcMExwOOz_dUqAhbnGg0y5WeYI1UptizlUfR_CBTglCdpjogJCCL2IuwYi7mH48J08cDBlfPKwX5Nuny6_LL9X1zeer5Yfryqq2mSonmOPQcIS2Q2B9Y1uoa2U1Sq1XK9bolXOuZsWw5Vb02NpOKFsL6Ip96OUFeX_UvZtXZTa29J9gMHfJj5B-mQje_P0S_K1Zx61ppRKt7orAmweBFH_OmCcz-mxxGCBgnLMRtVZcspbv0df_oJs4p1DsGaGZ5l2nmCiUPFKHUSV0p2Y4M_sUzcYcUjT7FM0xxVL16k8fp5rfsRXg3RHAMs2tx2Sy9RhsUUolP9NH_98P7gG1UK_v</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2606199402</pqid></control><display><type>article</type><title>COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework</title><source>MEDLINE</source><source>ScienceDirect Journals (5 years ago - present)</source><creator>Liu, Jiannan ; Dong, Bo ; Wang, Shuai ; Cui, Hui ; Fan, Deng-Ping ; Ma, Jiquan ; Chen, Geng</creator><creatorcontrib>Liu, Jiannan ; Dong, Bo ; Wang, Shuai ; Cui, Hui ; Fan, Deng-Ping ; Ma, Jiquan ; Chen, Geng</creatorcontrib><description>•We propose a novel two-stage transfer learning framework for segmenting COVID-19 lung infections from CT images. Our framework learns valuable knowledge from both natural images and CT images with pulmonary nodules, allowing more effective network training for improved performance.•We propose an effective infection segmentation network, called nCoVSegNet, which takes advantage of attention-aware feature fusion and large reception fields for accurate segmentation of lung infections.•Extensive experiments on two COVID-19 CT datasets demonstrate that our framework is able to segment lung infections accurately and outperforms state-of-the-art methods remarkably. [Display omitted] With the global outbreak of COVID-19 in early 2020, rapid diagnosis of COVID-19 has become the urgent need to control the spread of the epidemic. In clinical settings, lung infection segmentation from computed tomography (CT) images can provide vital information for the quantification and diagnosis of COVID-19. However, accurate infection segmentation is a challenging task due to (i) the low boundary contrast between infections and the surroundings, (ii) large variations of infection regions, and, most importantly, (iii) the shortage of large-scale annotated data. To address these issues, we propose a novel two-stage cross-domain transfer learning framework for the accurate segmentation of COVID-19 lung infections from CT images. Our framework consists of two major technical innovations, including an effective infection segmentation deep learning model, called nCoVSegNet, and a novel two-stage transfer learning strategy. Specifically, our nCoVSegNet conducts effective infection segmentation by taking advantage of attention-aware feature fusion and large receptive fields, aiming to resolve the issues related to low boundary contrast and large infection variations. To alleviate the shortage of the data, the nCoVSegNet is pre-trained using a two-stage cross-domain transfer learning strategy, which makes full use of the knowledge from natural images (i.e., ImageNet) and medical images (i.e., LIDC-IDRI) to boost the final training on CT images with COVID-19 infections. Extensive experiments demonstrate that our framework achieves superior segmentation accuracy and outperforms the cutting-edge models, both quantitatively and qualitatively.</description><identifier>ISSN: 1361-8415</identifier><identifier>ISSN: 1361-8423</identifier><identifier>EISSN: 1361-8423</identifier><identifier>DOI: 10.1016/j.media.2021.102205</identifier><identifier>PMID: 34425317</identifier><language>eng</language><publisher>Netherlands: Elsevier B.V</publisher><subject>Bronchopulmonary infection ; Computed tomography ; Coronaviruses ; COVID-19 ; Deep learning ; Diagnosis ; Disease control ; Domains ; Epidemics ; Humans ; Image processing ; Image segmentation ; Infections ; Lung - diagnostic imaging ; Lung infection segmentation ; Lungs ; Machine Learning ; Medical imaging ; SARS-CoV-2 ; Shortages ; Tomography, X-Ray Computed ; Transfer learning ; Viral diseases</subject><ispartof>Medical image analysis, 2021-12, Vol.74, p.102205-102205, Article 102205</ispartof><rights>2021 Elsevier B.V.</rights><rights>Copyright © 2021 Elsevier B.V. All rights reserved.</rights><rights>Copyright Elsevier BV Dec 2021</rights><rights>2021 Elsevier B.V. All rights reserved. 2021 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c487t-f20f1a71ea89ea0d7c8a554c6e366bb076bfff50202c1c2de8c924c52a9102ad3</citedby><cites>FETCH-LOGICAL-c487t-f20f1a71ea89ea0d7c8a554c6e366bb076bfff50202c1c2de8c924c52a9102ad3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.media.2021.102205$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>230,314,780,784,885,3549,27923,27924,45994</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34425317$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Liu, Jiannan</creatorcontrib><creatorcontrib>Dong, Bo</creatorcontrib><creatorcontrib>Wang, Shuai</creatorcontrib><creatorcontrib>Cui, Hui</creatorcontrib><creatorcontrib>Fan, Deng-Ping</creatorcontrib><creatorcontrib>Ma, Jiquan</creatorcontrib><creatorcontrib>Chen, Geng</creatorcontrib><title>COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework</title><title>Medical image analysis</title><addtitle>Med Image Anal</addtitle><description>•We propose a novel two-stage transfer learning framework for segmenting COVID-19 lung infections from CT images. Our framework learns valuable knowledge from both natural images and CT images with pulmonary nodules, allowing more effective network training for improved performance.•We propose an effective infection segmentation network, called nCoVSegNet, which takes advantage of attention-aware feature fusion and large reception fields for accurate segmentation of lung infections.•Extensive experiments on two COVID-19 CT datasets demonstrate that our framework is able to segment lung infections accurately and outperforms state-of-the-art methods remarkably. [Display omitted] With the global outbreak of COVID-19 in early 2020, rapid diagnosis of COVID-19 has become the urgent need to control the spread of the epidemic. In clinical settings, lung infection segmentation from computed tomography (CT) images can provide vital information for the quantification and diagnosis of COVID-19. However, accurate infection segmentation is a challenging task due to (i) the low boundary contrast between infections and the surroundings, (ii) large variations of infection regions, and, most importantly, (iii) the shortage of large-scale annotated data. To address these issues, we propose a novel two-stage cross-domain transfer learning framework for the accurate segmentation of COVID-19 lung infections from CT images. Our framework consists of two major technical innovations, including an effective infection segmentation deep learning model, called nCoVSegNet, and a novel two-stage transfer learning strategy. Specifically, our nCoVSegNet conducts effective infection segmentation by taking advantage of attention-aware feature fusion and large receptive fields, aiming to resolve the issues related to low boundary contrast and large infection variations. To alleviate the shortage of the data, the nCoVSegNet is pre-trained using a two-stage cross-domain transfer learning strategy, which makes full use of the knowledge from natural images (i.e., ImageNet) and medical images (i.e., LIDC-IDRI) to boost the final training on CT images with COVID-19 infections. Extensive experiments demonstrate that our framework achieves superior segmentation accuracy and outperforms the cutting-edge models, both quantitatively and qualitatively.</description><subject>Bronchopulmonary infection</subject><subject>Computed tomography</subject><subject>Coronaviruses</subject><subject>COVID-19</subject><subject>Deep learning</subject><subject>Diagnosis</subject><subject>Disease control</subject><subject>Domains</subject><subject>Epidemics</subject><subject>Humans</subject><subject>Image processing</subject><subject>Image segmentation</subject><subject>Infections</subject><subject>Lung - diagnostic imaging</subject><subject>Lung infection segmentation</subject><subject>Lungs</subject><subject>Machine Learning</subject><subject>Medical imaging</subject><subject>SARS-CoV-2</subject><subject>Shortages</subject><subject>Tomography, X-Ray Computed</subject><subject>Transfer learning</subject><subject>Viral diseases</subject><issn>1361-8415</issn><issn>1361-8423</issn><issn>1361-8423</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kUtvEzEUhS0EoqXwC5CQJTZsJvg1npkFSCgUqFSpG2Br3XiuU4cZu9gzifj3dZISAQtWfn33-J57CHnJ2YIzrt9uFiP2HhaCCV5uhGD1I3LOpeZVq4R8fNrz-ow8y3nDGGuUYk_JmVRK1JI356Rf3ny_-ljxjg5zWFMfHNrJx0AzrkcMExwOOz_dUqAhbnGg0y5WeYI1UptizlUfR_CBTglCdpjogJCCL2IuwYi7mH48J08cDBlfPKwX5Nuny6_LL9X1zeer5Yfryqq2mSonmOPQcIS2Q2B9Y1uoa2U1Sq1XK9bolXOuZsWw5Vb02NpOKFsL6Ip96OUFeX_UvZtXZTa29J9gMHfJj5B-mQje_P0S_K1Zx61ppRKt7orAmweBFH_OmCcz-mxxGCBgnLMRtVZcspbv0df_oJs4p1DsGaGZ5l2nmCiUPFKHUSV0p2Y4M_sUzcYcUjT7FM0xxVL16k8fp5rfsRXg3RHAMs2tx2Sy9RhsUUolP9NH_98P7gG1UK_v</recordid><startdate>20211201</startdate><enddate>20211201</enddate><creator>Liu, Jiannan</creator><creator>Dong, Bo</creator><creator>Wang, Shuai</creator><creator>Cui, Hui</creator><creator>Fan, Deng-Ping</creator><creator>Ma, Jiquan</creator><creator>Chen, Geng</creator><general>Elsevier B.V</general><general>Elsevier BV</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QO</scope><scope>8FD</scope><scope>FR3</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20211201</creationdate><title>COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework</title><author>Liu, Jiannan ; Dong, Bo ; Wang, Shuai ; Cui, Hui ; Fan, Deng-Ping ; Ma, Jiquan ; Chen, Geng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c487t-f20f1a71ea89ea0d7c8a554c6e366bb076bfff50202c1c2de8c924c52a9102ad3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Bronchopulmonary infection</topic><topic>Computed tomography</topic><topic>Coronaviruses</topic><topic>COVID-19</topic><topic>Deep learning</topic><topic>Diagnosis</topic><topic>Disease control</topic><topic>Domains</topic><topic>Epidemics</topic><topic>Humans</topic><topic>Image processing</topic><topic>Image segmentation</topic><topic>Infections</topic><topic>Lung - diagnostic imaging</topic><topic>Lung infection segmentation</topic><topic>Lungs</topic><topic>Machine Learning</topic><topic>Medical imaging</topic><topic>SARS-CoV-2</topic><topic>Shortages</topic><topic>Tomography, X-Ray Computed</topic><topic>Transfer learning</topic><topic>Viral diseases</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Liu, Jiannan</creatorcontrib><creatorcontrib>Dong, Bo</creatorcontrib><creatorcontrib>Wang, Shuai</creatorcontrib><creatorcontrib>Cui, Hui</creatorcontrib><creatorcontrib>Fan, Deng-Ping</creatorcontrib><creatorcontrib>Ma, Jiquan</creatorcontrib><creatorcontrib>Chen, Geng</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Biotechnology Research Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Medical image analysis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Liu, Jiannan</au><au>Dong, Bo</au><au>Wang, Shuai</au><au>Cui, Hui</au><au>Fan, Deng-Ping</au><au>Ma, Jiquan</au><au>Chen, Geng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework</atitle><jtitle>Medical image analysis</jtitle><addtitle>Med Image Anal</addtitle><date>2021-12-01</date><risdate>2021</risdate><volume>74</volume><spage>102205</spage><epage>102205</epage><pages>102205-102205</pages><artnum>102205</artnum><issn>1361-8415</issn><issn>1361-8423</issn><eissn>1361-8423</eissn><abstract>•We propose a novel two-stage transfer learning framework for segmenting COVID-19 lung infections from CT images. Our framework learns valuable knowledge from both natural images and CT images with pulmonary nodules, allowing more effective network training for improved performance.•We propose an effective infection segmentation network, called nCoVSegNet, which takes advantage of attention-aware feature fusion and large reception fields for accurate segmentation of lung infections.•Extensive experiments on two COVID-19 CT datasets demonstrate that our framework is able to segment lung infections accurately and outperforms state-of-the-art methods remarkably. [Display omitted] With the global outbreak of COVID-19 in early 2020, rapid diagnosis of COVID-19 has become the urgent need to control the spread of the epidemic. In clinical settings, lung infection segmentation from computed tomography (CT) images can provide vital information for the quantification and diagnosis of COVID-19. However, accurate infection segmentation is a challenging task due to (i) the low boundary contrast between infections and the surroundings, (ii) large variations of infection regions, and, most importantly, (iii) the shortage of large-scale annotated data. To address these issues, we propose a novel two-stage cross-domain transfer learning framework for the accurate segmentation of COVID-19 lung infections from CT images. Our framework consists of two major technical innovations, including an effective infection segmentation deep learning model, called nCoVSegNet, and a novel two-stage transfer learning strategy. Specifically, our nCoVSegNet conducts effective infection segmentation by taking advantage of attention-aware feature fusion and large receptive fields, aiming to resolve the issues related to low boundary contrast and large infection variations. To alleviate the shortage of the data, the nCoVSegNet is pre-trained using a two-stage cross-domain transfer learning strategy, which makes full use of the knowledge from natural images (i.e., ImageNet) and medical images (i.e., LIDC-IDRI) to boost the final training on CT images with COVID-19 infections. Extensive experiments demonstrate that our framework achieves superior segmentation accuracy and outperforms the cutting-edge models, both quantitatively and qualitatively.</abstract><cop>Netherlands</cop><pub>Elsevier B.V</pub><pmid>34425317</pmid><doi>10.1016/j.media.2021.102205</doi><tpages>1</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1361-8415
ispartof Medical image analysis, 2021-12, Vol.74, p.102205-102205, Article 102205
issn 1361-8415
1361-8423
1361-8423
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_8342869
source MEDLINE; ScienceDirect Journals (5 years ago - present)
subjects Bronchopulmonary infection
Computed tomography
Coronaviruses
COVID-19
Deep learning
Diagnosis
Disease control
Domains
Epidemics
Humans
Image processing
Image segmentation
Infections
Lung - diagnostic imaging
Lung infection segmentation
Lungs
Machine Learning
Medical imaging
SARS-CoV-2
Shortages
Tomography, X-Ray Computed
Transfer learning
Viral diseases
title COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T13%3A14%3A53IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=COVID-19%20lung%20infection%20segmentation%20with%20a%20novel%20two-stage%20cross-domain%20transfer%20learning%20framework&rft.jtitle=Medical%20image%20analysis&rft.au=Liu,%20Jiannan&rft.date=2021-12-01&rft.volume=74&rft.spage=102205&rft.epage=102205&rft.pages=102205-102205&rft.artnum=102205&rft.issn=1361-8415&rft.eissn=1361-8423&rft_id=info:doi/10.1016/j.media.2021.102205&rft_dat=%3Cproquest_pubme%3E2564130819%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2606199402&rft_id=info:pmid/34425317&rft_els_id=S1361841521002504&rfr_iscdi=true