Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction

Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing 2024, Vol.33, p.910-925
Hauptverfasser: Pan, Jiayi, Yu, Hengyong, Gao, Zhifan, Wang, Shaoyu, Zhang, Heye, Wu, Weiwen
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 925
container_issue
container_start_page 910
container_title IEEE transactions on image processing
container_volume 33
creator Pan, Jiayi
Yu, Hengyong
Gao, Zhifan
Wang, Shaoyu
Zhang, Heye
Wu, Weiwen
description Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.
doi_str_mv 10.1109/TIP.2024.3351382
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2915570877</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2915570877</sourcerecordid><originalsourceid>FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</originalsourceid><addsrcrecordid>eNpdkD1PwzAQhi0EouVjZ0KRWFhSznYcO2NV8VGpogiFOUocp6QkcbAdEPx6HLUwMN3p9LynVw9CFxhmGENyky6fZgRINKOUYSrIAZriJMIhQEQO_Q6MhxxHyQSdWLsFwBHD8TGaeJSM6xSlS6dM7uoPFTwrW5dD3gTr3tVt_e2vugselfvU5i2otAlW_uxUGc67TaOCVLd6Y_L-tZY-K3VnnRnkGDpDR1XeWHW-n6fo5e42XTyEq_X9cjFfhZIS7sIYRFT4qrQoBBEFpcALwipZJjEtZCU55JGQwKBihYwrTkAwIhWW3LePk5Keouvd397o90FZl7W1lapp8k7pwWYkwYxxEJx79OofutWD6Xy7kRJABBfUU7CjpNHWGlVlvanb3HxlGLLReOaNZ6PxbG_cRy73j4eiVeVf4Fcx_QG4mntM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2918028783</pqid></control><display><type>article</type><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><source>IEEE/IET Electronic Library (IEL)</source><creator>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</creator><creatorcontrib>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</creatorcontrib><description>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</description><identifier>ISSN: 1057-7149</identifier><identifier>EISSN: 1941-0042</identifier><identifier>DOI: 10.1109/TIP.2024.3351382</identifier><identifier>PMID: 38224516</identifier><language>eng</language><publisher>United States: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</publisher><subject>Convergence ; Convolution ; Divergence ; Image degradation ; Image quality ; Image reconstruction ; Inverse problems ; Iron ; Iterative methods ; Neural networks ; Optimization ; Transformers</subject><ispartof>IEEE transactions on image processing, 2024, Vol.33, p.910-925</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</citedby><orcidid>0000-0002-1323-1655 ; 0000-0002-5852-0813 ; 0000-0002-1576-4439 ; 0000-0001-7687-2719 ; 0000-0003-3828-0629 ; 0000-0002-8295-5104</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,4024,27923,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38224516$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pan, Jiayi</creatorcontrib><creatorcontrib>Yu, Hengyong</creatorcontrib><creatorcontrib>Gao, Zhifan</creatorcontrib><creatorcontrib>Wang, Shaoyu</creatorcontrib><creatorcontrib>Zhang, Heye</creatorcontrib><creatorcontrib>Wu, Weiwen</creatorcontrib><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><title>IEEE transactions on image processing</title><addtitle>IEEE Trans Image Process</addtitle><description>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</description><subject>Convergence</subject><subject>Convolution</subject><subject>Divergence</subject><subject>Image degradation</subject><subject>Image quality</subject><subject>Image reconstruction</subject><subject>Inverse problems</subject><subject>Iron</subject><subject>Iterative methods</subject><subject>Neural networks</subject><subject>Optimization</subject><subject>Transformers</subject><issn>1057-7149</issn><issn>1941-0042</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpdkD1PwzAQhi0EouVjZ0KRWFhSznYcO2NV8VGpogiFOUocp6QkcbAdEPx6HLUwMN3p9LynVw9CFxhmGENyky6fZgRINKOUYSrIAZriJMIhQEQO_Q6MhxxHyQSdWLsFwBHD8TGaeJSM6xSlS6dM7uoPFTwrW5dD3gTr3tVt_e2vugselfvU5i2otAlW_uxUGc67TaOCVLd6Y_L-tZY-K3VnnRnkGDpDR1XeWHW-n6fo5e42XTyEq_X9cjFfhZIS7sIYRFT4qrQoBBEFpcALwipZJjEtZCU55JGQwKBihYwrTkAwIhWW3LePk5Keouvd397o90FZl7W1lapp8k7pwWYkwYxxEJx79OofutWD6Xy7kRJABBfUU7CjpNHWGlVlvanb3HxlGLLReOaNZ6PxbG_cRy73j4eiVeVf4Fcx_QG4mntM</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Pan, Jiayi</creator><creator>Yu, Hengyong</creator><creator>Gao, Zhifan</creator><creator>Wang, Shaoyu</creator><creator>Zhang, Heye</creator><creator>Wu, Weiwen</creator><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-1323-1655</orcidid><orcidid>https://orcid.org/0000-0002-5852-0813</orcidid><orcidid>https://orcid.org/0000-0002-1576-4439</orcidid><orcidid>https://orcid.org/0000-0001-7687-2719</orcidid><orcidid>https://orcid.org/0000-0003-3828-0629</orcidid><orcidid>https://orcid.org/0000-0002-8295-5104</orcidid></search><sort><creationdate>2024</creationdate><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><author>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Convergence</topic><topic>Convolution</topic><topic>Divergence</topic><topic>Image degradation</topic><topic>Image quality</topic><topic>Image reconstruction</topic><topic>Inverse problems</topic><topic>Iron</topic><topic>Iterative methods</topic><topic>Neural networks</topic><topic>Optimization</topic><topic>Transformers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pan, Jiayi</creatorcontrib><creatorcontrib>Yu, Hengyong</creatorcontrib><creatorcontrib>Gao, Zhifan</creatorcontrib><creatorcontrib>Wang, Shaoyu</creatorcontrib><creatorcontrib>Zhang, Heye</creatorcontrib><creatorcontrib>Wu, Weiwen</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on image processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pan, Jiayi</au><au>Yu, Hengyong</au><au>Gao, Zhifan</au><au>Wang, Shaoyu</au><au>Zhang, Heye</au><au>Wu, Weiwen</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</atitle><jtitle>IEEE transactions on image processing</jtitle><addtitle>IEEE Trans Image Process</addtitle><date>2024</date><risdate>2024</risdate><volume>33</volume><spage>910</spage><epage>925</epage><pages>910-925</pages><issn>1057-7149</issn><eissn>1941-0042</eissn><abstract>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</abstract><cop>United States</cop><pub>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</pub><pmid>38224516</pmid><doi>10.1109/TIP.2024.3351382</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-1323-1655</orcidid><orcidid>https://orcid.org/0000-0002-5852-0813</orcidid><orcidid>https://orcid.org/0000-0002-1576-4439</orcidid><orcidid>https://orcid.org/0000-0001-7687-2719</orcidid><orcidid>https://orcid.org/0000-0003-3828-0629</orcidid><orcidid>https://orcid.org/0000-0002-8295-5104</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1057-7149
ispartof IEEE transactions on image processing, 2024, Vol.33, p.910-925
issn 1057-7149
1941-0042
language eng
recordid cdi_proquest_miscellaneous_2915570877
source IEEE/IET Electronic Library (IEL)
subjects Convergence
Convolution
Divergence
Image degradation
Image quality
Image reconstruction
Inverse problems
Iron
Iterative methods
Neural networks
Optimization
Transformers
title Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T08%3A57%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Iterative%20Residual%20Optimization%20Network%20for%20Limited-Angle%20Tomographic%20Reconstruction&rft.jtitle=IEEE%20transactions%20on%20image%20processing&rft.au=Pan,%20Jiayi&rft.date=2024&rft.volume=33&rft.spage=910&rft.epage=925&rft.pages=910-925&rft.issn=1057-7149&rft.eissn=1941-0042&rft_id=info:doi/10.1109/TIP.2024.3351382&rft_dat=%3Cproquest_cross%3E2915570877%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2918028783&rft_id=info:pmid/38224516&rfr_iscdi=true