Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering

•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Measurement : journal of the International Measurement Confederation 2021-09, Vol.182, p.109663, Article 109663
Hauptverfasser: Goyal, Bhawna, Chyophel Lepcha, Dawa, Dogra, Ayush, Bhateja, Vikrant, Lay-Ekuakille, Aimé
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 109663
container_title Measurement : journal of the International Measurement Confederation
container_volume 182
creator Goyal, Bhawna
Chyophel Lepcha, Dawa
Dogra, Ayush
Bhateja, Vikrant
Lay-Ekuakille, Aimé
description •An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.
doi_str_mv 10.1016/j.measurement.2021.109663
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2569692533</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0263224121006321</els_id><sourcerecordid>2569692533</sourcerecordid><originalsourceid>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</originalsourceid><addsrcrecordid>eNqNkEFr3DAQhUVpodu0_0GlZ2-lkS2vjmVpmkBCLgn0JrTSKGixrVQjN6S_vgpbaI45DAMz7z14H2OfpdhKIfXX43ZGR2vBGZe6BQGy3Y3W6g3byN2oul7Cz7dsI0CrDqCX79kHoqMQQiujN-zP9X87d0to46YnSsRz5PM61dTNObiJp9ndI48rpbzwGWtJnvjBEQbeDlTL6mvL4e7RFVyQiDfpcs9Dnl1aeC1uoZjLzGOaKpb2-sjeRTcRfvq3z9jd-ffb_UV3dfPjcv_tqvMwmtoNCDi6fggHDRCMH72Jrh_1AdQw9BFHVACjALcL3njp49ArEQd12AXwTkR1xr6cch9K_rUiVXvMa2k1ycKgjTYwKNVU5qTyJRMVjPahtM7lyUphn1Hbo32B2j6jtifUzbs_ebHV-J2wWPIJF48hFfTVhpxekfIXJ1KROw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2569692533</pqid></control><display><type>article</type><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><source>Access via ScienceDirect (Elsevier)</source><creator>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</creator><creatorcontrib>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</creatorcontrib><description>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</description><identifier>ISSN: 0263-2241</identifier><identifier>EISSN: 1873-412X</identifier><identifier>DOI: 10.1016/j.measurement.2021.109663</identifier><language>eng</language><publisher>London: Elsevier Ltd</publisher><subject>Complexity ; Computer vision ; Domain Transform Filtering ; Domains ; Fusion ; Image filters ; Image processing ; Image processing systems ; Image quality ; Image resolution ; Measurement ; Measurement of Fusion ; Medical diagnosis ; Medical Image Fusion for Diagnosis ; Medical imaging ; Physicians ; Quality assessment ; Rolling Guidance Filter ; SSE ; Studies ; Subjective Measurement &amp; Analysis ; Sum rules ; Target recognition</subject><ispartof>Measurement : journal of the International Measurement Confederation, 2021-09, Vol.182, p.109663, Article 109663</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright Elsevier Science Ltd. Sep 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</citedby><cites>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</cites><orcidid>0000-0003-0111-9612</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.measurement.2021.109663$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Goyal, Bhawna</creatorcontrib><creatorcontrib>Chyophel Lepcha, Dawa</creatorcontrib><creatorcontrib>Dogra, Ayush</creatorcontrib><creatorcontrib>Bhateja, Vikrant</creatorcontrib><creatorcontrib>Lay-Ekuakille, Aimé</creatorcontrib><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><title>Measurement : journal of the International Measurement Confederation</title><description>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</description><subject>Complexity</subject><subject>Computer vision</subject><subject>Domain Transform Filtering</subject><subject>Domains</subject><subject>Fusion</subject><subject>Image filters</subject><subject>Image processing</subject><subject>Image processing systems</subject><subject>Image quality</subject><subject>Image resolution</subject><subject>Measurement</subject><subject>Measurement of Fusion</subject><subject>Medical diagnosis</subject><subject>Medical Image Fusion for Diagnosis</subject><subject>Medical imaging</subject><subject>Physicians</subject><subject>Quality assessment</subject><subject>Rolling Guidance Filter</subject><subject>SSE</subject><subject>Studies</subject><subject>Subjective Measurement &amp; Analysis</subject><subject>Sum rules</subject><subject>Target recognition</subject><issn>0263-2241</issn><issn>1873-412X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNqNkEFr3DAQhUVpodu0_0GlZ2-lkS2vjmVpmkBCLgn0JrTSKGixrVQjN6S_vgpbaI45DAMz7z14H2OfpdhKIfXX43ZGR2vBGZe6BQGy3Y3W6g3byN2oul7Cz7dsI0CrDqCX79kHoqMQQiujN-zP9X87d0to46YnSsRz5PM61dTNObiJp9ndI48rpbzwGWtJnvjBEQbeDlTL6mvL4e7RFVyQiDfpcs9Dnl1aeC1uoZjLzGOaKpb2-sjeRTcRfvq3z9jd-ffb_UV3dfPjcv_tqvMwmtoNCDi6fggHDRCMH72Jrh_1AdQw9BFHVACjALcL3njp49ArEQd12AXwTkR1xr6cch9K_rUiVXvMa2k1ycKgjTYwKNVU5qTyJRMVjPahtM7lyUphn1Hbo32B2j6jtifUzbs_ebHV-J2wWPIJF48hFfTVhpxekfIXJ1KROw</recordid><startdate>202109</startdate><enddate>202109</enddate><creator>Goyal, Bhawna</creator><creator>Chyophel Lepcha, Dawa</creator><creator>Dogra, Ayush</creator><creator>Bhateja, Vikrant</creator><creator>Lay-Ekuakille, Aimé</creator><general>Elsevier Ltd</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-0111-9612</orcidid></search><sort><creationdate>202109</creationdate><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><author>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Complexity</topic><topic>Computer vision</topic><topic>Domain Transform Filtering</topic><topic>Domains</topic><topic>Fusion</topic><topic>Image filters</topic><topic>Image processing</topic><topic>Image processing systems</topic><topic>Image quality</topic><topic>Image resolution</topic><topic>Measurement</topic><topic>Measurement of Fusion</topic><topic>Medical diagnosis</topic><topic>Medical Image Fusion for Diagnosis</topic><topic>Medical imaging</topic><topic>Physicians</topic><topic>Quality assessment</topic><topic>Rolling Guidance Filter</topic><topic>SSE</topic><topic>Studies</topic><topic>Subjective Measurement &amp; Analysis</topic><topic>Sum rules</topic><topic>Target recognition</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Goyal, Bhawna</creatorcontrib><creatorcontrib>Chyophel Lepcha, Dawa</creatorcontrib><creatorcontrib>Dogra, Ayush</creatorcontrib><creatorcontrib>Bhateja, Vikrant</creatorcontrib><creatorcontrib>Lay-Ekuakille, Aimé</creatorcontrib><collection>CrossRef</collection><jtitle>Measurement : journal of the International Measurement Confederation</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Goyal, Bhawna</au><au>Chyophel Lepcha, Dawa</au><au>Dogra, Ayush</au><au>Bhateja, Vikrant</au><au>Lay-Ekuakille, Aimé</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</atitle><jtitle>Measurement : journal of the International Measurement Confederation</jtitle><date>2021-09</date><risdate>2021</risdate><volume>182</volume><spage>109663</spage><pages>109663-</pages><artnum>109663</artnum><issn>0263-2241</issn><eissn>1873-412X</eissn><abstract>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</abstract><cop>London</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.measurement.2021.109663</doi><orcidid>https://orcid.org/0000-0003-0111-9612</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0263-2241
ispartof Measurement : journal of the International Measurement Confederation, 2021-09, Vol.182, p.109663, Article 109663
issn 0263-2241
1873-412X
language eng
recordid cdi_proquest_journals_2569692533
source Access via ScienceDirect (Elsevier)
subjects Complexity
Computer vision
Domain Transform Filtering
Domains
Fusion
Image filters
Image processing
Image processing systems
Image quality
Image resolution
Measurement
Measurement of Fusion
Medical diagnosis
Medical Image Fusion for Diagnosis
Medical imaging
Physicians
Quality assessment
Rolling Guidance Filter
SSE
Studies
Subjective Measurement & Analysis
Sum rules
Target recognition
title Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T20%3A33%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Measurement%20and%20analysis%20of%20multi-modal%20image%20fusion%20metrics%20based%20on%20structure%20awareness%20using%20domain%20transform%20filtering&rft.jtitle=Measurement%20:%20journal%20of%20the%20International%20Measurement%20Confederation&rft.au=Goyal,%20Bhawna&rft.date=2021-09&rft.volume=182&rft.spage=109663&rft.pages=109663-&rft.artnum=109663&rft.issn=0263-2241&rft.eissn=1873-412X&rft_id=info:doi/10.1016/j.measurement.2021.109663&rft_dat=%3Cproquest_cross%3E2569692533%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2569692533&rft_id=info:pmid/&rft_els_id=S0263224121006321&rfr_iscdi=true