Dual U-Net residual networks for cardiac magnetic resonance images super-resolution

•Developed the Dual U-Net residual network for network to reconstruct cardiac magnetic resonance images super-resolution.•Designed the dual U-Net module.•The method effectively improves the super-resolution reconstruction effect of cardiac magnetic resonance images. Heart disease is a vital disease...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computer methods and programs in biomedicine 2022-05, Vol.218, p.106707-106707, Article 106707
Hauptverfasser: Qiu, Defu, Cheng, Yuhu, Wang, Xuesong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 106707
container_issue
container_start_page 106707
container_title Computer methods and programs in biomedicine
container_volume 218
creator Qiu, Defu
Cheng, Yuhu
Wang, Xuesong
description •Developed the Dual U-Net residual network for network to reconstruct cardiac magnetic resonance images super-resolution.•Designed the dual U-Net module.•The method effectively improves the super-resolution reconstruction effect of cardiac magnetic resonance images. Heart disease is a vital disease that has threatened human health, and is the number one killer of human life. Moreover, with the added influence of recent health factors, its incidence rate keeps showing an upward trend. Today, cardiac magnetic resonance (CMR) imaging can provide a full range of structural and functional information for the heart, and has become an important tool for the diagnosis and treatment of heart disease. Therefore, improving the image resolution of CMR has an important medical value for the diagnosis and condition assessment of heart disease. At present, most single-image super-resolution (SISR) reconstruction methods have some serious problems, such as insufficient feature information mining, difficulty to determine the dependence of each channel of feature map, and reconstruction error when reconstructing high-resolution image. To solve these problems, we have proposed and implemented a dual U-Net residual network (DURN) for super-resolution of CMR images. Specifically, we first propose a U-Net residual network (URN) model, which is divided into the up-branch and the down-branch. The up-branch is composed of residual blocks and up-blocks to extract and upsample deep features; the down-branch is composed of residual blocks and down-blocks to extract and downsample deep features. Based on the URN model, we employ this a dual U-Net residual network (DURN) model, which combines the extracted deep features of the same position between the first URN and the second URN through residual connection. It can make full use of the features extracted by the first URN to extract deeper features of low-resolution images. When the scale factors are 2, 3, and 4, our DURN can obtain 37.86 dB, 33.96 dB, and 31.65 dB on the Set5 dataset, which shows (i) a maximum improvement of 4.17 dB, 3.55 dB, and 3.22dB over the Bicubic algorithm, and (ii) a minimum improvement of 0.34 dB, 0.14 dB, and 0.11 dB over the LapSRN algorithm. Comprehensive experimental study results on benchmark datasets demonstrate that our proposed DURN can not only achieve better performance for peak signal to noise ratio (PSNR) and structural similarity index (SSIM) values than other state-of-the-art SR image algorithms
doi_str_mv 10.1016/j.cmpb.2022.106707
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2637319693</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S016926072200092X</els_id><sourcerecordid>2637319693</sourcerecordid><originalsourceid>FETCH-LOGICAL-c422t-5c74f1774b4c0c6d98ef0e9abdc1b5c50f1a8c91ade42598533dc7a1679087183</originalsourceid><addsrcrecordid>eNp9kL1OwzAURi0EoqXwAgwoI0uK7cR2IrEg_qUKBuhsOdc3yCVNip2AeHsctTAy2f507qfrQ8gpo3NGmbxYzWG9qeacch4DqajaI1NWKJ4qIcU-mUaoTLmkakKOQlhRSrkQ8pBMMhEvmcqn5OVmME2yTJ-wTzwGZ8dni_1X599DUnc-AeOtM5CszVvMHYxY15oWMHExw5CEYYM-HeNm6F3XHpOD2jQBT3bnjCzvbl-vH9LF8_3j9dUihZzzPhWg8poplVc5UJC2LLCmWJrKAqsECFozU0DJjMWci7IQWWZBGSZVSQvFimxGzre9G999DBh6vXYBsGlMi90QNJeZylgpyyyifIuC70LwWOuNj9v7b82oHmXqlR5l6lGm3sqMQ2e7_qFao_0b-bUXgcstgPGXnw69DuAwmrHOI_Tadu6__h-yroXQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2637319693</pqid></control><display><type>article</type><title>Dual U-Net residual networks for cardiac magnetic resonance images super-resolution</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Qiu, Defu ; Cheng, Yuhu ; Wang, Xuesong</creator><creatorcontrib>Qiu, Defu ; Cheng, Yuhu ; Wang, Xuesong</creatorcontrib><description>•Developed the Dual U-Net residual network for network to reconstruct cardiac magnetic resonance images super-resolution.•Designed the dual U-Net module.•The method effectively improves the super-resolution reconstruction effect of cardiac magnetic resonance images. Heart disease is a vital disease that has threatened human health, and is the number one killer of human life. Moreover, with the added influence of recent health factors, its incidence rate keeps showing an upward trend. Today, cardiac magnetic resonance (CMR) imaging can provide a full range of structural and functional information for the heart, and has become an important tool for the diagnosis and treatment of heart disease. Therefore, improving the image resolution of CMR has an important medical value for the diagnosis and condition assessment of heart disease. At present, most single-image super-resolution (SISR) reconstruction methods have some serious problems, such as insufficient feature information mining, difficulty to determine the dependence of each channel of feature map, and reconstruction error when reconstructing high-resolution image. To solve these problems, we have proposed and implemented a dual U-Net residual network (DURN) for super-resolution of CMR images. Specifically, we first propose a U-Net residual network (URN) model, which is divided into the up-branch and the down-branch. The up-branch is composed of residual blocks and up-blocks to extract and upsample deep features; the down-branch is composed of residual blocks and down-blocks to extract and downsample deep features. Based on the URN model, we employ this a dual U-Net residual network (DURN) model, which combines the extracted deep features of the same position between the first URN and the second URN through residual connection. It can make full use of the features extracted by the first URN to extract deeper features of low-resolution images. When the scale factors are 2, 3, and 4, our DURN can obtain 37.86 dB, 33.96 dB, and 31.65 dB on the Set5 dataset, which shows (i) a maximum improvement of 4.17 dB, 3.55 dB, and 3.22dB over the Bicubic algorithm, and (ii) a minimum improvement of 0.34 dB, 0.14 dB, and 0.11 dB over the LapSRN algorithm. Comprehensive experimental study results on benchmark datasets demonstrate that our proposed DURN can not only achieve better performance for peak signal to noise ratio (PSNR) and structural similarity index (SSIM) values than other state-of-the-art SR image algorithms, but also reconstruct clearer super-resolution CMR images which have richer details, edges, and texture.</description><identifier>ISSN: 0169-2607</identifier><identifier>EISSN: 1872-7565</identifier><identifier>DOI: 10.1016/j.cmpb.2022.106707</identifier><identifier>PMID: 35255374</identifier><language>eng</language><publisher>Ireland: Elsevier B.V</publisher><subject>Algorithms ; Cardiac magnetic resonance (CMR) ; Disease Progression ; Heart Diseases - diagnostic imaging ; Humans ; Image Processing, Computer-Assisted - methods ; Image Processing, Computer-Assisted - standards ; Magnetic Resonance Imaging ; Residual connection ; Signal-To-Noise Ratio ; Single-image super-resolution (SISR) ; Super-resolution ; U-Net residual network (URN)</subject><ispartof>Computer methods and programs in biomedicine, 2022-05, Vol.218, p.106707-106707, Article 106707</ispartof><rights>2022 Elsevier B.V.</rights><rights>Copyright © 2022 Elsevier B.V. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c422t-5c74f1774b4c0c6d98ef0e9abdc1b5c50f1a8c91ade42598533dc7a1679087183</citedby><cites>FETCH-LOGICAL-c422t-5c74f1774b4c0c6d98ef0e9abdc1b5c50f1a8c91ade42598533dc7a1679087183</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.cmpb.2022.106707$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,777,781,3537,27905,27906,45976</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/35255374$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Qiu, Defu</creatorcontrib><creatorcontrib>Cheng, Yuhu</creatorcontrib><creatorcontrib>Wang, Xuesong</creatorcontrib><title>Dual U-Net residual networks for cardiac magnetic resonance images super-resolution</title><title>Computer methods and programs in biomedicine</title><addtitle>Comput Methods Programs Biomed</addtitle><description>•Developed the Dual U-Net residual network for network to reconstruct cardiac magnetic resonance images super-resolution.•Designed the dual U-Net module.•The method effectively improves the super-resolution reconstruction effect of cardiac magnetic resonance images. Heart disease is a vital disease that has threatened human health, and is the number one killer of human life. Moreover, with the added influence of recent health factors, its incidence rate keeps showing an upward trend. Today, cardiac magnetic resonance (CMR) imaging can provide a full range of structural and functional information for the heart, and has become an important tool for the diagnosis and treatment of heart disease. Therefore, improving the image resolution of CMR has an important medical value for the diagnosis and condition assessment of heart disease. At present, most single-image super-resolution (SISR) reconstruction methods have some serious problems, such as insufficient feature information mining, difficulty to determine the dependence of each channel of feature map, and reconstruction error when reconstructing high-resolution image. To solve these problems, we have proposed and implemented a dual U-Net residual network (DURN) for super-resolution of CMR images. Specifically, we first propose a U-Net residual network (URN) model, which is divided into the up-branch and the down-branch. The up-branch is composed of residual blocks and up-blocks to extract and upsample deep features; the down-branch is composed of residual blocks and down-blocks to extract and downsample deep features. Based on the URN model, we employ this a dual U-Net residual network (DURN) model, which combines the extracted deep features of the same position between the first URN and the second URN through residual connection. It can make full use of the features extracted by the first URN to extract deeper features of low-resolution images. When the scale factors are 2, 3, and 4, our DURN can obtain 37.86 dB, 33.96 dB, and 31.65 dB on the Set5 dataset, which shows (i) a maximum improvement of 4.17 dB, 3.55 dB, and 3.22dB over the Bicubic algorithm, and (ii) a minimum improvement of 0.34 dB, 0.14 dB, and 0.11 dB over the LapSRN algorithm. Comprehensive experimental study results on benchmark datasets demonstrate that our proposed DURN can not only achieve better performance for peak signal to noise ratio (PSNR) and structural similarity index (SSIM) values than other state-of-the-art SR image algorithms, but also reconstruct clearer super-resolution CMR images which have richer details, edges, and texture.</description><subject>Algorithms</subject><subject>Cardiac magnetic resonance (CMR)</subject><subject>Disease Progression</subject><subject>Heart Diseases - diagnostic imaging</subject><subject>Humans</subject><subject>Image Processing, Computer-Assisted - methods</subject><subject>Image Processing, Computer-Assisted - standards</subject><subject>Magnetic Resonance Imaging</subject><subject>Residual connection</subject><subject>Signal-To-Noise Ratio</subject><subject>Single-image super-resolution (SISR)</subject><subject>Super-resolution</subject><subject>U-Net residual network (URN)</subject><issn>0169-2607</issn><issn>1872-7565</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kL1OwzAURi0EoqXwAgwoI0uK7cR2IrEg_qUKBuhsOdc3yCVNip2AeHsctTAy2f507qfrQ8gpo3NGmbxYzWG9qeacch4DqajaI1NWKJ4qIcU-mUaoTLmkakKOQlhRSrkQ8pBMMhEvmcqn5OVmME2yTJ-wTzwGZ8dni_1X599DUnc-AeOtM5CszVvMHYxY15oWMHExw5CEYYM-HeNm6F3XHpOD2jQBT3bnjCzvbl-vH9LF8_3j9dUihZzzPhWg8poplVc5UJC2LLCmWJrKAqsECFozU0DJjMWci7IQWWZBGSZVSQvFimxGzre9G999DBh6vXYBsGlMi90QNJeZylgpyyyifIuC70LwWOuNj9v7b82oHmXqlR5l6lGm3sqMQ2e7_qFao_0b-bUXgcstgPGXnw69DuAwmrHOI_Tadu6__h-yroXQ</recordid><startdate>202205</startdate><enddate>202205</enddate><creator>Qiu, Defu</creator><creator>Cheng, Yuhu</creator><creator>Wang, Xuesong</creator><general>Elsevier B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>202205</creationdate><title>Dual U-Net residual networks for cardiac magnetic resonance images super-resolution</title><author>Qiu, Defu ; Cheng, Yuhu ; Wang, Xuesong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c422t-5c74f1774b4c0c6d98ef0e9abdc1b5c50f1a8c91ade42598533dc7a1679087183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Cardiac magnetic resonance (CMR)</topic><topic>Disease Progression</topic><topic>Heart Diseases - diagnostic imaging</topic><topic>Humans</topic><topic>Image Processing, Computer-Assisted - methods</topic><topic>Image Processing, Computer-Assisted - standards</topic><topic>Magnetic Resonance Imaging</topic><topic>Residual connection</topic><topic>Signal-To-Noise Ratio</topic><topic>Single-image super-resolution (SISR)</topic><topic>Super-resolution</topic><topic>U-Net residual network (URN)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Qiu, Defu</creatorcontrib><creatorcontrib>Cheng, Yuhu</creatorcontrib><creatorcontrib>Wang, Xuesong</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Computer methods and programs in biomedicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Qiu, Defu</au><au>Cheng, Yuhu</au><au>Wang, Xuesong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dual U-Net residual networks for cardiac magnetic resonance images super-resolution</atitle><jtitle>Computer methods and programs in biomedicine</jtitle><addtitle>Comput Methods Programs Biomed</addtitle><date>2022-05</date><risdate>2022</risdate><volume>218</volume><spage>106707</spage><epage>106707</epage><pages>106707-106707</pages><artnum>106707</artnum><issn>0169-2607</issn><eissn>1872-7565</eissn><abstract>•Developed the Dual U-Net residual network for network to reconstruct cardiac magnetic resonance images super-resolution.•Designed the dual U-Net module.•The method effectively improves the super-resolution reconstruction effect of cardiac magnetic resonance images. Heart disease is a vital disease that has threatened human health, and is the number one killer of human life. Moreover, with the added influence of recent health factors, its incidence rate keeps showing an upward trend. Today, cardiac magnetic resonance (CMR) imaging can provide a full range of structural and functional information for the heart, and has become an important tool for the diagnosis and treatment of heart disease. Therefore, improving the image resolution of CMR has an important medical value for the diagnosis and condition assessment of heart disease. At present, most single-image super-resolution (SISR) reconstruction methods have some serious problems, such as insufficient feature information mining, difficulty to determine the dependence of each channel of feature map, and reconstruction error when reconstructing high-resolution image. To solve these problems, we have proposed and implemented a dual U-Net residual network (DURN) for super-resolution of CMR images. Specifically, we first propose a U-Net residual network (URN) model, which is divided into the up-branch and the down-branch. The up-branch is composed of residual blocks and up-blocks to extract and upsample deep features; the down-branch is composed of residual blocks and down-blocks to extract and downsample deep features. Based on the URN model, we employ this a dual U-Net residual network (DURN) model, which combines the extracted deep features of the same position between the first URN and the second URN through residual connection. It can make full use of the features extracted by the first URN to extract deeper features of low-resolution images. When the scale factors are 2, 3, and 4, our DURN can obtain 37.86 dB, 33.96 dB, and 31.65 dB on the Set5 dataset, which shows (i) a maximum improvement of 4.17 dB, 3.55 dB, and 3.22dB over the Bicubic algorithm, and (ii) a minimum improvement of 0.34 dB, 0.14 dB, and 0.11 dB over the LapSRN algorithm. Comprehensive experimental study results on benchmark datasets demonstrate that our proposed DURN can not only achieve better performance for peak signal to noise ratio (PSNR) and structural similarity index (SSIM) values than other state-of-the-art SR image algorithms, but also reconstruct clearer super-resolution CMR images which have richer details, edges, and texture.</abstract><cop>Ireland</cop><pub>Elsevier B.V</pub><pmid>35255374</pmid><doi>10.1016/j.cmpb.2022.106707</doi><tpages>1</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0169-2607
ispartof Computer methods and programs in biomedicine, 2022-05, Vol.218, p.106707-106707, Article 106707
issn 0169-2607
1872-7565
language eng
recordid cdi_proquest_miscellaneous_2637319693
source MEDLINE; Elsevier ScienceDirect Journals
subjects Algorithms
Cardiac magnetic resonance (CMR)
Disease Progression
Heart Diseases - diagnostic imaging
Humans
Image Processing, Computer-Assisted - methods
Image Processing, Computer-Assisted - standards
Magnetic Resonance Imaging
Residual connection
Signal-To-Noise Ratio
Single-image super-resolution (SISR)
Super-resolution
U-Net residual network (URN)
title Dual U-Net residual networks for cardiac magnetic resonance images super-resolution
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T08%3A17%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dual%20U-Net%20residual%20networks%20for%20cardiac%20magnetic%20resonance%20images%20super-resolution&rft.jtitle=Computer%20methods%20and%20programs%20in%20biomedicine&rft.au=Qiu,%20Defu&rft.date=2022-05&rft.volume=218&rft.spage=106707&rft.epage=106707&rft.pages=106707-106707&rft.artnum=106707&rft.issn=0169-2607&rft.eissn=1872-7565&rft_id=info:doi/10.1016/j.cmpb.2022.106707&rft_dat=%3Cproquest_cross%3E2637319693%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2637319693&rft_id=info:pmid/35255374&rft_els_id=S016926072200092X&rfr_iscdi=true