MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays
The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtract...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on artificial intelligence 2024-10, p.1-10 |
---|---|
Hauptverfasser: | , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 10 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE transactions on artificial intelligence |
container_volume | |
creator | Singh, Anushikha Hussain, Rukhshanda Bhattacharya, Rajarshi Lall, Brejesh Panigrahi, B.K. Agrawal, Anjali Agrawal, Anurag Thangakunam, Balamugesh Christopher, DJ |
description | The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ). |
doi_str_mv | 10.1109/TAI.2024.3483731 |
format | Article |
fullrecord | <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TAI_2024_3483731</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10726922</ieee_id><sourcerecordid>10_1109_TAI_2024_3483731</sourcerecordid><originalsourceid>FETCH-LOGICAL-c622-d8a402b9374ca4b0bed20611c9964057c0087a15d0662088f277ae46632821873</originalsourceid><addsrcrecordid>eNpNkLFuwjAURa2qlYooe4cO_oHQ5xfHdrql0KZIQAcYukUmeVFT0gTZgYq_bxAMTPcO99zhMPYoYCwExM_rZDZGQDkOpQl1KG7YAFUsAhkZcXvV79nI-x8AwEggoh6w7WKaBGmyfOGLfd1VwSq3NXHbFHy6tzVPuo6armobnlJDznbVgXhSHMh566p-sKTur3VbXraOv7YN8dV-t3Pk_YmpGj75Jt_xr8DZo39gd6WtPY0uOWTr97f15COYf6azSTIPcoUYFMZKwE0caplbuYENFQhKiDyOlYRI5wBGWxEVoBSCMSVqbUkqFaJBYXQ4ZHC-zV3rvaMy27nq17pjJiA76cp6XdlJV3bR1SNPZ6Qioqu57s0hhv_uEWRC</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><source>IEEE Electronic Library (IEL)</source><creator>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</creator><creatorcontrib>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</creatorcontrib><description>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</description><identifier>ISSN: 2691-4581</identifier><identifier>EISSN: 2691-4581</identifier><identifier>DOI: 10.1109/TAI.2024.3483731</identifier><identifier>CODEN: ITAICB</identifier><language>eng</language><publisher>IEEE</publisher><subject>Biomedical imaging ; Bone suppression ; Bones ; Chest x-rays ; Decoding ; Generative adversarial network ; Generative adversarial networks ; Generators ; Image segmentation ; Lung ; Ribs ; X-ray imaging ; X-rays</subject><ispartof>IEEE transactions on artificial intelligence, 2024-10, p.1-10</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10726922$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,27907,27908,54741</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10726922$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Singh, Anushikha</creatorcontrib><creatorcontrib>Hussain, Rukhshanda</creatorcontrib><creatorcontrib>Bhattacharya, Rajarshi</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><creatorcontrib>Panigrahi, B.K.</creatorcontrib><creatorcontrib>Agrawal, Anjali</creatorcontrib><creatorcontrib>Agrawal, Anurag</creatorcontrib><creatorcontrib>Thangakunam, Balamugesh</creatorcontrib><creatorcontrib>Christopher, DJ</creatorcontrib><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><title>IEEE transactions on artificial intelligence</title><addtitle>TAI</addtitle><description>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</description><subject>Biomedical imaging</subject><subject>Bone suppression</subject><subject>Bones</subject><subject>Chest x-rays</subject><subject>Decoding</subject><subject>Generative adversarial network</subject><subject>Generative adversarial networks</subject><subject>Generators</subject><subject>Image segmentation</subject><subject>Lung</subject><subject>Ribs</subject><subject>X-ray imaging</subject><subject>X-rays</subject><issn>2691-4581</issn><issn>2691-4581</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkLFuwjAURa2qlYooe4cO_oHQ5xfHdrql0KZIQAcYukUmeVFT0gTZgYq_bxAMTPcO99zhMPYoYCwExM_rZDZGQDkOpQl1KG7YAFUsAhkZcXvV79nI-x8AwEggoh6w7WKaBGmyfOGLfd1VwSq3NXHbFHy6tzVPuo6armobnlJDznbVgXhSHMh566p-sKTur3VbXraOv7YN8dV-t3Pk_YmpGj75Jt_xr8DZo39gd6WtPY0uOWTr97f15COYf6azSTIPcoUYFMZKwE0caplbuYENFQhKiDyOlYRI5wBGWxEVoBSCMSVqbUkqFaJBYXQ4ZHC-zV3rvaMy27nq17pjJiA76cp6XdlJV3bR1SNPZ6Qioqu57s0hhv_uEWRC</recordid><startdate>20241021</startdate><enddate>20241021</enddate><creator>Singh, Anushikha</creator><creator>Hussain, Rukhshanda</creator><creator>Bhattacharya, Rajarshi</creator><creator>Lall, Brejesh</creator><creator>Panigrahi, B.K.</creator><creator>Agrawal, Anjali</creator><creator>Agrawal, Anurag</creator><creator>Thangakunam, Balamugesh</creator><creator>Christopher, DJ</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20241021</creationdate><title>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</title><author>Singh, Anushikha ; Hussain, Rukhshanda ; Bhattacharya, Rajarshi ; Lall, Brejesh ; Panigrahi, B.K. ; Agrawal, Anjali ; Agrawal, Anurag ; Thangakunam, Balamugesh ; Christopher, DJ</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c622-d8a402b9374ca4b0bed20611c9964057c0087a15d0662088f277ae46632821873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Biomedical imaging</topic><topic>Bone suppression</topic><topic>Bones</topic><topic>Chest x-rays</topic><topic>Decoding</topic><topic>Generative adversarial network</topic><topic>Generative adversarial networks</topic><topic>Generators</topic><topic>Image segmentation</topic><topic>Lung</topic><topic>Ribs</topic><topic>X-ray imaging</topic><topic>X-rays</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Singh, Anushikha</creatorcontrib><creatorcontrib>Hussain, Rukhshanda</creatorcontrib><creatorcontrib>Bhattacharya, Rajarshi</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><creatorcontrib>Panigrahi, B.K.</creatorcontrib><creatorcontrib>Agrawal, Anjali</creatorcontrib><creatorcontrib>Agrawal, Anurag</creatorcontrib><creatorcontrib>Thangakunam, Balamugesh</creatorcontrib><creatorcontrib>Christopher, DJ</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE transactions on artificial intelligence</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Singh, Anushikha</au><au>Hussain, Rukhshanda</au><au>Bhattacharya, Rajarshi</au><au>Lall, Brejesh</au><au>Panigrahi, B.K.</au><au>Agrawal, Anjali</au><au>Agrawal, Anurag</au><au>Thangakunam, Balamugesh</au><au>Christopher, DJ</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays</atitle><jtitle>IEEE transactions on artificial intelligence</jtitle><stitle>TAI</stitle><date>2024-10-21</date><risdate>2024</risdate><spage>1</spage><epage>10</epage><pages>1-10</pages><issn>2691-4581</issn><eissn>2691-4581</eissn><coden>ITAICB</coden><abstract>The bone structure in a chest x-ray creates trouble for a radiologist to examine the organs, manifestation of disease, and hidden tiny abnormalities. Bone suppression in chest x-rays allows better examination of lung fields. This has the potential to improve diagnostic accuracy. Dual-energy subtraction imaging is a standard bone suppression technique that delivers a higher dose of radiation and requires specific hardware. This paper proposes a novel multi-scale and dual attention-guided generative adversarial network (MDA-GAN) to transform chest x-rays into bone-suppressed x-rays in an unsupervised manner. We incorporate a spatial attention module to generate attention maps that were further concatenated with the coarsely generated bone segmentation mask. This dual attention is introduced to the generator at multiple scales in between the skip connection of the encoder and decoder layer. The proposed dual attention multi-scale mechanism helps the generator to learn that only bones need to be removed on the chest x-ray without tempering the remaining parts. The proposed MDA-GAN is trained with adversarial loss combined with deep supervised cycle consistency and structure similarity for unpaired training images. We employ supervision heads in all the decoder layers to convert the activation maps into an output comparable to the scaled-down images and minimize the cycle consistency loss in a deep supervised manner. Experiments are conducted on an unpaired dataset including the public and our in-house Indian dataset and results show that incorporating dual attention at multiple scales and deep cycle consistency in translation networks significantly improves the quality of bone-suppressed images. ( https://github.com/rB080/ribsup.git ).</abstract><pub>IEEE</pub><doi>10.1109/TAI.2024.3483731</doi><tpages>10</tpages></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2691-4581 |
ispartof | IEEE transactions on artificial intelligence, 2024-10, p.1-10 |
issn | 2691-4581 2691-4581 |
language | eng |
recordid | cdi_crossref_primary_10_1109_TAI_2024_3483731 |
source | IEEE Electronic Library (IEL) |
subjects | Biomedical imaging Bone suppression Bones Chest x-rays Decoding Generative adversarial network Generative adversarial networks Generators Image segmentation Lung Ribs X-ray imaging X-rays |
title | MDA-GAN: Multi-Scale and Dual Attention Generative Adversarial Network for Bone Suppression in Chest X-rays |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T20%3A13%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MDA-GAN:%20Multi-Scale%20and%20Dual%20Attention%20Generative%20Adversarial%20Network%20for%20Bone%20Suppression%20in%20Chest%20X-rays&rft.jtitle=IEEE%20transactions%20on%20artificial%20intelligence&rft.au=Singh,%20Anushikha&rft.date=2024-10-21&rft.spage=1&rft.epage=10&rft.pages=1-10&rft.issn=2691-4581&rft.eissn=2691-4581&rft.coden=ITAICB&rft_id=info:doi/10.1109/TAI.2024.3483731&rft_dat=%3Ccrossref_RIE%3E10_1109_TAI_2024_3483731%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10726922&rfr_iscdi=true |