A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images
Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable bidirectional translation. We propose a patch-level concatenated cyc...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2023-11 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Rai, Swati Bhatt, Jignesh S Patra, Sarat Kumar |
description | Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable bidirectional translation. We propose a patch-level concatenated cyclic conditional generative adversarial network (pCCGAN) embedded with adaptive dictionary learning. It consists of two cyclically connected CGANs of 47 layers each; where both generators (each of 32 layers) are conditioned with concatenation of alternate unpaired patches from input and target modality images (not ground truth) of the same organ. The key idea is to exploit cross-neighborhood contextual feature information that bounds the translation space and boosts generalization. The generators are further equipped with adaptive dictionaries learned from the contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks that employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize the variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI. |
doi_str_mv | 10.48550/arxiv.2311.02480 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2311_02480</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2886749949</sourcerecordid><originalsourceid>FETCH-LOGICAL-a529-e0704424ecaa81f1cf3fa3b4b11147738a76d1c2cff855c005168626b28bbb793</originalsourceid><addsrcrecordid>eNotj8FOwzAQRC0kJKrSD-CEJc4p9tqJnWMpUCoVEKKco41jI5c0Dk4K9O8JLac5zNNoHiEXnE2lTlN2jfHHf01BcD5lIDU7ISMQgidaApyRSddtGGOQKUhTMSIvM_raR2_6ek9vwq6pbEVvrW3pk-2_Q_ygLkT61rTo49DM96b2hq4jNl2NvQ8NDY4-2sobrOlyi--2OyenDuvOTv5zTNb3d-v5Q7J6Xizns1WCKeSJZYpJCdIaRM0dN044FKUsOedSKaFRZRU3YJwbrAxjKc90BlkJuixLlYsxuTzOHnyLNvotxn3x510cvAfi6ki0MXzubNcXm7CLzfCpAK0zJfNc5uIX9ehZ5Q</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2886749949</pqid></control><display><type>article</type><title>A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Rai, Swati ; Bhatt, Jignesh S ; Patra, Sarat Kumar</creator><creatorcontrib>Rai, Swati ; Bhatt, Jignesh S ; Patra, Sarat Kumar</creatorcontrib><description>Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable bidirectional translation. We propose a patch-level concatenated cyclic conditional generative adversarial network (pCCGAN) embedded with adaptive dictionary learning. It consists of two cyclically connected CGANs of 47 layers each; where both generators (each of 32 layers) are conditioned with concatenation of alternate unpaired patches from input and target modality images (not ground truth) of the same organ. The key idea is to exploit cross-neighborhood contextual feature information that bounds the translation space and boosts generalization. The generators are further equipped with adaptive dictionaries learned from the contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks that employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize the variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2311.02480</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Ablation ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning ; Dictionaries ; Generative adversarial networks ; Ill posed problems ; Machine learning ; Medical imaging ; Minimax technique ; Qualitative analysis</subject><ispartof>arXiv.org, 2023-11</ispartof><rights>2023. This work is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by-nc-nd/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27904</link.rule.ids><backlink>$$Uhttps://doi.org/10.1109/SSP53291.2023.10207960$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2311.02480$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Rai, Swati</creatorcontrib><creatorcontrib>Bhatt, Jignesh S</creatorcontrib><creatorcontrib>Patra, Sarat Kumar</creatorcontrib><title>A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images</title><title>arXiv.org</title><description>Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable bidirectional translation. We propose a patch-level concatenated cyclic conditional generative adversarial network (pCCGAN) embedded with adaptive dictionary learning. It consists of two cyclically connected CGANs of 47 layers each; where both generators (each of 32 layers) are conditioned with concatenation of alternate unpaired patches from input and target modality images (not ground truth) of the same organ. The key idea is to exploit cross-neighborhood contextual feature information that bounds the translation space and boosts generalization. The generators are further equipped with adaptive dictionaries learned from the contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks that employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize the variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI.</description><subject>Ablation</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><subject>Dictionaries</subject><subject>Generative adversarial networks</subject><subject>Ill posed problems</subject><subject>Machine learning</subject><subject>Medical imaging</subject><subject>Minimax technique</subject><subject>Qualitative analysis</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotj8FOwzAQRC0kJKrSD-CEJc4p9tqJnWMpUCoVEKKco41jI5c0Dk4K9O8JLac5zNNoHiEXnE2lTlN2jfHHf01BcD5lIDU7ISMQgidaApyRSddtGGOQKUhTMSIvM_raR2_6ek9vwq6pbEVvrW3pk-2_Q_ygLkT61rTo49DM96b2hq4jNl2NvQ8NDY4-2sobrOlyi--2OyenDuvOTv5zTNb3d-v5Q7J6Xizns1WCKeSJZYpJCdIaRM0dN044FKUsOedSKaFRZRU3YJwbrAxjKc90BlkJuixLlYsxuTzOHnyLNvotxn3x510cvAfi6ki0MXzubNcXm7CLzfCpAK0zJfNc5uIX9ehZ5Q</recordid><startdate>20231104</startdate><enddate>20231104</enddate><creator>Rai, Swati</creator><creator>Bhatt, Jignesh S</creator><creator>Patra, Sarat Kumar</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20231104</creationdate><title>A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images</title><author>Rai, Swati ; Bhatt, Jignesh S ; Patra, Sarat Kumar</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a529-e0704424ecaa81f1cf3fa3b4b11147738a76d1c2cff855c005168626b28bbb793</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Ablation</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><topic>Dictionaries</topic><topic>Generative adversarial networks</topic><topic>Ill posed problems</topic><topic>Machine learning</topic><topic>Medical imaging</topic><topic>Minimax technique</topic><topic>Qualitative analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>Rai, Swati</creatorcontrib><creatorcontrib>Bhatt, Jignesh S</creatorcontrib><creatorcontrib>Patra, Sarat Kumar</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rai, Swati</au><au>Bhatt, Jignesh S</au><au>Patra, Sarat Kumar</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images</atitle><jtitle>arXiv.org</jtitle><date>2023-11-04</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable bidirectional translation. We propose a patch-level concatenated cyclic conditional generative adversarial network (pCCGAN) embedded with adaptive dictionary learning. It consists of two cyclically connected CGANs of 47 layers each; where both generators (each of 32 layers) are conditioned with concatenation of alternate unpaired patches from input and target modality images (not ground truth) of the same organ. The key idea is to exploit cross-neighborhood contextual feature information that bounds the translation space and boosts generalization. The generators are further equipped with adaptive dictionaries learned from the contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks that employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize the variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2311.02480</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2023-11 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2311_02480 |
source | arXiv.org; Free E- Journals |
subjects | Ablation Computer Science - Computer Vision and Pattern Recognition Computer Science - Learning Dictionaries Generative adversarial networks Ill posed problems Machine learning Medical imaging Minimax technique Qualitative analysis |
title | A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T09%3A25%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Strictly%20Bounded%20Deep%20Network%20for%20Unpaired%20Cyclic%20Translation%20of%20Medical%20Images&rft.jtitle=arXiv.org&rft.au=Rai,%20Swati&rft.date=2023-11-04&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2311.02480&rft_dat=%3Cproquest_arxiv%3E2886749949%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2886749949&rft_id=info:pmid/&rfr_iscdi=true |