Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction
Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on image processing 2024, Vol.33, p.910-925 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 925 |
---|---|
container_issue | |
container_start_page | 910 |
container_title | IEEE transactions on image processing |
container_volume | 33 |
creator | Pan, Jiayi Yu, Hengyong Gao, Zhifan Wang, Shaoyu Zhang, Heye Wu, Weiwen |
description | Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods. |
doi_str_mv | 10.1109/TIP.2024.3351382 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2915570877</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2915570877</sourcerecordid><originalsourceid>FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</originalsourceid><addsrcrecordid>eNpdkD1PwzAQhi0EouVjZ0KRWFhSznYcO2NV8VGpogiFOUocp6QkcbAdEPx6HLUwMN3p9LynVw9CFxhmGENyky6fZgRINKOUYSrIAZriJMIhQEQO_Q6MhxxHyQSdWLsFwBHD8TGaeJSM6xSlS6dM7uoPFTwrW5dD3gTr3tVt_e2vugselfvU5i2otAlW_uxUGc67TaOCVLd6Y_L-tZY-K3VnnRnkGDpDR1XeWHW-n6fo5e42XTyEq_X9cjFfhZIS7sIYRFT4qrQoBBEFpcALwipZJjEtZCU55JGQwKBihYwrTkAwIhWW3LePk5Keouvd397o90FZl7W1lapp8k7pwWYkwYxxEJx79OofutWD6Xy7kRJABBfUU7CjpNHWGlVlvanb3HxlGLLReOaNZ6PxbG_cRy73j4eiVeVf4Fcx_QG4mntM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2918028783</pqid></control><display><type>article</type><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><source>IEEE/IET Electronic Library (IEL)</source><creator>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</creator><creatorcontrib>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</creatorcontrib><description>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</description><identifier>ISSN: 1057-7149</identifier><identifier>EISSN: 1941-0042</identifier><identifier>DOI: 10.1109/TIP.2024.3351382</identifier><identifier>PMID: 38224516</identifier><language>eng</language><publisher>United States: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</publisher><subject>Convergence ; Convolution ; Divergence ; Image degradation ; Image quality ; Image reconstruction ; Inverse problems ; Iron ; Iterative methods ; Neural networks ; Optimization ; Transformers</subject><ispartof>IEEE transactions on image processing, 2024, Vol.33, p.910-925</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</citedby><orcidid>0000-0002-1323-1655 ; 0000-0002-5852-0813 ; 0000-0002-1576-4439 ; 0000-0001-7687-2719 ; 0000-0003-3828-0629 ; 0000-0002-8295-5104</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,4024,27923,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38224516$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pan, Jiayi</creatorcontrib><creatorcontrib>Yu, Hengyong</creatorcontrib><creatorcontrib>Gao, Zhifan</creatorcontrib><creatorcontrib>Wang, Shaoyu</creatorcontrib><creatorcontrib>Zhang, Heye</creatorcontrib><creatorcontrib>Wu, Weiwen</creatorcontrib><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><title>IEEE transactions on image processing</title><addtitle>IEEE Trans Image Process</addtitle><description>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</description><subject>Convergence</subject><subject>Convolution</subject><subject>Divergence</subject><subject>Image degradation</subject><subject>Image quality</subject><subject>Image reconstruction</subject><subject>Inverse problems</subject><subject>Iron</subject><subject>Iterative methods</subject><subject>Neural networks</subject><subject>Optimization</subject><subject>Transformers</subject><issn>1057-7149</issn><issn>1941-0042</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpdkD1PwzAQhi0EouVjZ0KRWFhSznYcO2NV8VGpogiFOUocp6QkcbAdEPx6HLUwMN3p9LynVw9CFxhmGENyky6fZgRINKOUYSrIAZriJMIhQEQO_Q6MhxxHyQSdWLsFwBHD8TGaeJSM6xSlS6dM7uoPFTwrW5dD3gTr3tVt_e2vugselfvU5i2otAlW_uxUGc67TaOCVLd6Y_L-tZY-K3VnnRnkGDpDR1XeWHW-n6fo5e42XTyEq_X9cjFfhZIS7sIYRFT4qrQoBBEFpcALwipZJjEtZCU55JGQwKBihYwrTkAwIhWW3LePk5Keouvd397o90FZl7W1lapp8k7pwWYkwYxxEJx79OofutWD6Xy7kRJABBfUU7CjpNHWGlVlvanb3HxlGLLReOaNZ6PxbG_cRy73j4eiVeVf4Fcx_QG4mntM</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Pan, Jiayi</creator><creator>Yu, Hengyong</creator><creator>Gao, Zhifan</creator><creator>Wang, Shaoyu</creator><creator>Zhang, Heye</creator><creator>Wu, Weiwen</creator><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-1323-1655</orcidid><orcidid>https://orcid.org/0000-0002-5852-0813</orcidid><orcidid>https://orcid.org/0000-0002-1576-4439</orcidid><orcidid>https://orcid.org/0000-0001-7687-2719</orcidid><orcidid>https://orcid.org/0000-0003-3828-0629</orcidid><orcidid>https://orcid.org/0000-0002-8295-5104</orcidid></search><sort><creationdate>2024</creationdate><title>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</title><author>Pan, Jiayi ; Yu, Hengyong ; Gao, Zhifan ; Wang, Shaoyu ; Zhang, Heye ; Wu, Weiwen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c327t-6084b0043bb828b3307b25fcd963bcfc70a48c050f5bc6f720852ce1c722469d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Convergence</topic><topic>Convolution</topic><topic>Divergence</topic><topic>Image degradation</topic><topic>Image quality</topic><topic>Image reconstruction</topic><topic>Inverse problems</topic><topic>Iron</topic><topic>Iterative methods</topic><topic>Neural networks</topic><topic>Optimization</topic><topic>Transformers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pan, Jiayi</creatorcontrib><creatorcontrib>Yu, Hengyong</creatorcontrib><creatorcontrib>Gao, Zhifan</creatorcontrib><creatorcontrib>Wang, Shaoyu</creatorcontrib><creatorcontrib>Zhang, Heye</creatorcontrib><creatorcontrib>Wu, Weiwen</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on image processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pan, Jiayi</au><au>Yu, Hengyong</au><au>Gao, Zhifan</au><au>Wang, Shaoyu</au><au>Zhang, Heye</au><au>Wu, Weiwen</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction</atitle><jtitle>IEEE transactions on image processing</jtitle><addtitle>IEEE Trans Image Process</addtitle><date>2024</date><risdate>2024</risdate><volume>33</volume><spage>910</spage><epage>925</epage><pages>910-925</pages><issn>1057-7149</issn><eissn>1941-0042</eissn><abstract>Limited-angle tomographic reconstruction is one of the typical ill-posed inverse problems, leading to edge divergence with degraded image quality. Recently, deep learning has been introduced into image reconstruction and achieved great results. However, existing deep reconstruction methods have not fully explored data consistency, resulting in poor performance. In addition, deep reconstruction methods are still mathematically inexplicable and unstable. In this work, we propose an iterative residual optimization network (IRON) for limited-angle tomographic reconstruction. First, a new optimization objective function is established to overcome false negative and positive artifacts induced by limited-angle measurements. We integrate neural network priors as a regularizer to explore deep features within residual data. Furthermore, the block-coordinate descent is employed to achieve a novel iterative framework. Second, a convolution assisted transformer is carefully elaborated to capture both local and long-range pixel interactions simultaneously. Regarding the visual transformer, the multi-head attention is further redesigned to reduce computational costs and protect reconstructed image features. Third, based on the relative error convergence property of the convolution assisted transformer, a mathematical convergence analysis is also provided for our IRON. Both numerically simulated and clinically collected real cardiac datasets are employed to validate the effectiveness and advantages of the proposed IRON. The results show that IRON outperforms other state-of-the-art methods.</abstract><cop>United States</cop><pub>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</pub><pmid>38224516</pmid><doi>10.1109/TIP.2024.3351382</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-1323-1655</orcidid><orcidid>https://orcid.org/0000-0002-5852-0813</orcidid><orcidid>https://orcid.org/0000-0002-1576-4439</orcidid><orcidid>https://orcid.org/0000-0001-7687-2719</orcidid><orcidid>https://orcid.org/0000-0003-3828-0629</orcidid><orcidid>https://orcid.org/0000-0002-8295-5104</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1057-7149 |
ispartof | IEEE transactions on image processing, 2024, Vol.33, p.910-925 |
issn | 1057-7149 1941-0042 |
language | eng |
recordid | cdi_proquest_miscellaneous_2915570877 |
source | IEEE/IET Electronic Library (IEL) |
subjects | Convergence Convolution Divergence Image degradation Image quality Image reconstruction Inverse problems Iron Iterative methods Neural networks Optimization Transformers |
title | Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T08%3A57%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Iterative%20Residual%20Optimization%20Network%20for%20Limited-Angle%20Tomographic%20Reconstruction&rft.jtitle=IEEE%20transactions%20on%20image%20processing&rft.au=Pan,%20Jiayi&rft.date=2024&rft.volume=33&rft.spage=910&rft.epage=925&rft.pages=910-925&rft.issn=1057-7149&rft.eissn=1941-0042&rft_id=info:doi/10.1109/TIP.2024.3351382&rft_dat=%3Cproquest_cross%3E2915570877%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2918028783&rft_id=info:pmid/38224516&rfr_iscdi=true |