MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays

The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtract...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on artificial intelligence 2024-10, p.1-10
Hauptverfasser: Singh, Anushikha, Hussain, Rukhshanda, Bhattacharya, Rajarshi, Lall, Brejesh, Panigrahi, B.K., Agrawal, Anjali, Agrawal, Anurag, Thangakunam, Balamugesh, Christopher, DJ
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 10
container_issue
container_start_page 1
container_title IEEE transactions on artificial intelligence
container_volume
creator Singh, Anushikha
Hussain, Rukhshanda
Bhattacharya, Rajarshi
Lall, Brejesh
Panigrahi, B.K.
Agrawal, Anjali
Agrawal, Anurag
Thangakunam, Balamugesh
Christopher, DJ
description The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).
doi_str_mv 10.1109/TAI.2024.3483731
format Article
fullrecord <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TAI_2024_3483731</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10726922</ieee_id><sourcerecordid>10_1109_TAI_2024_3483731</sourcerecordid><originalsourceid>FETCH-LOGICAL-c622-d8a402b9374ca4b0bed20611c9964057c0087a15d0662088f277ae46632821873</originalsourceid><addsrcrecordid>eNpNkLFuwjAURa2qlYooe4cO_oHQ5xfHdrql0KZIQAcYukUmeVFT0gTZgYq_bxAMTPcO99zhMPYoYCwExM_rZDZGQDkOpQl1KG7YAFUsAhkZcXvV79nI-x8AwEggoh6w7WKaBGmyfOGLfd1VwSq3NXHbFHy6tzVPuo6armobnlJDznbVgXhSHMh566p-sKTur3VbXraOv7YN8dV-t3Pk_YmpGj75Jt_xr8DZo39gd6WtPY0uOWTr97f15COYf6azSTIPcoUYFMZKwE0caplbuYENFQhKiDyOlYRI5wBGWxEVoBSCMSVqbUkqFaJBYXQ4ZHC-zV3rvaMy27nq17pjJiA76cp6XdlJV3bR1SNPZ6Qioqu57s0hhv_uEWRC</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><source>IEEE Electronic Library (IEL)</source><creator>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</creator><creatorcontrib>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</creatorcontrib><description>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</description><identifier>ISSN: 2691-4581</identifier><identifier>EISSN: 2691-4581</identifier><identifier>DOI: 10.1109/TAI.2024.3483731</identifier><identifier>CODEN: ITAICB</identifier><language>eng</language><publisher>IEEE</publisher><subject>Biomedical imaging ; Bone suppression ; Bones ; Chest x-rays ; Decoding ; Generative adversarial network ; Generative adversarial networks ; Generators ; Image segmentation ; Lung ; Ribs ; X-ray imaging ; X-rays</subject><ispartof>IEEE transactions on artificial intelligence, 2024-10, p.1-10</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10726922$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,27907,27908,54741</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10726922$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Singh, Anushikha</creatorcontrib><creatorcontrib>Hussain, Rukhshanda</creatorcontrib><creatorcontrib>Bhattacharya, Rajarshi</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><creatorcontrib>Panigrahi, B.K.</creatorcontrib><creatorcontrib>Agrawal, Anjali</creatorcontrib><creatorcontrib>Agrawal, Anurag</creatorcontrib><creatorcontrib>Thangakunam, Balamugesh</creatorcontrib><creatorcontrib>Christopher, DJ</creatorcontrib><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><title>IEEE transactions on artificial intelligence</title><addtitle>TAI</addtitle><description>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</description><subject>Biomedical imaging</subject><subject>Bone suppression</subject><subject>Bones</subject><subject>Chest x-rays</subject><subject>Decoding</subject><subject>Generative adversarial network</subject><subject>Generative adversarial networks</subject><subject>Generators</subject><subject>Image segmentation</subject><subject>Lung</subject><subject>Ribs</subject><subject>X-ray imaging</subject><subject>X-rays</subject><issn>2691-4581</issn><issn>2691-4581</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkLFuwjAURa2qlYooe4cO_oHQ5xfHdrql0KZIQAcYukUmeVFT0gTZgYq_bxAMTPcO99zhMPYoYCwExM_rZDZGQDkOpQl1KG7YAFUsAhkZcXvV79nI-x8AwEggoh6w7WKaBGmyfOGLfd1VwSq3NXHbFHy6tzVPuo6armobnlJDznbVgXhSHMh566p-sKTur3VbXraOv7YN8dV-t3Pk_YmpGj75Jt_xr8DZo39gd6WtPY0uOWTr97f15COYf6azSTIPcoUYFMZKwE0caplbuYENFQhKiDyOlYRI5wBGWxEVoBSCMSVqbUkqFaJBYXQ4ZHC-zV3rvaMy27nq17pjJiA76cp6XdlJV3bR1SNPZ6Qioqu57s0hhv_uEWRC</recordid><startdate>20241021</startdate><enddate>20241021</enddate><creator>Singh, Anushikha</creator><creator>Hussain, Rukhshanda</creator><creator>Bhattacharya, Rajarshi</creator><creator>Lall, Brejesh</creator><creator>Panigrahi, B.K.</creator><creator>Agrawal, Anjali</creator><creator>Agrawal, Anurag</creator><creator>Thangakunam, Balamugesh</creator><creator>Christopher, DJ</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20241021</creationdate><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><author>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c622-d8a402b9374ca4b0bed20611c9964057c0087a15d0662088f277ae46632821873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Biomedical imaging</topic><topic>Bone suppression</topic><topic>Bones</topic><topic>Chest x-rays</topic><topic>Decoding</topic><topic>Generative adversarial network</topic><topic>Generative adversarial networks</topic><topic>Generators</topic><topic>Image segmentation</topic><topic>Lung</topic><topic>Ribs</topic><topic>X-ray imaging</topic><topic>X-rays</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Singh, Anushikha</creatorcontrib><creatorcontrib>Hussain, Rukhshanda</creatorcontrib><creatorcontrib>Bhattacharya, Rajarshi</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><creatorcontrib>Panigrahi, B.K.</creatorcontrib><creatorcontrib>Agrawal, Anjali</creatorcontrib><creatorcontrib>Agrawal, Anurag</creatorcontrib><creatorcontrib>Thangakunam, Balamugesh</creatorcontrib><creatorcontrib>Christopher, DJ</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE transactions on artificial intelligence</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Singh, Anushikha</au><au>Hussain, Rukhshanda</au><au>Bhattacharya, Rajarshi</au><au>Lall, Brejesh</au><au>Panigrahi, B.K.</au><au>Agrawal, Anjali</au><au>Agrawal, Anurag</au><au>Thangakunam, Balamugesh</au><au>Christopher, DJ</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</atitle><jtitle>IEEE transactions on artificial intelligence</jtitle><stitle>TAI</stitle><date>2024-10-21</date><risdate>2024</risdate><spage>1</spage><epage>10</epage><pages>1-10</pages><issn>2691-4581</issn><eissn>2691-4581</eissn><coden>ITAICB</coden><abstract>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</abstract><pub>IEEE</pub><doi>10.1109/TAI.2024.3483731</doi><tpages>10</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2691-4581
ispartof IEEE transactions on artificial intelligence, 2024-10, p.1-10
issn 2691-4581
2691-4581
language eng
recordid cdi_crossref_primary_10_1109_TAI_2024_3483731
source IEEE Electronic Library (IEL)
subjects Biomedical imaging
Bone suppression
Bones
Chest x-rays
Decoding
Generative adversarial network
Generative adversarial networks
Generators
Image segmentation
Lung
Ribs
X-ray imaging
X-rays
title MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T20%3A13%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MDA-GAN:%20Multi-Scale%20and%20Dual%20Attention%20Generative%20Adversarial%20Network%20for%20Bone%20Suppression%20in%20Chest%20X-rays&rft.jtitle=IEEE%20transactions%20on%20artificial%20intelligence&rft.au=Singh,%20Anushikha&rft.date=2024-10-21&rft.spage=1&rft.epage=10&rft.pages=1-10&rft.issn=2691-4581&rft.eissn=2691-4581&rft.coden=ITAICB&rft_id=info:doi/10.1109/TAI.2024.3483731&rft_dat=%3Ccrossref_RIE%3E10_1109_TAI_2024_3483731%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10726922&rfr_iscdi=true