Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering
•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved. Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images...
Gespeichert in:
Veröffentlicht in: | Measurement : journal of the International Measurement Confederation 2021-09, Vol.182, p.109663, Article 109663 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 109663 |
container_title | Measurement : journal of the International Measurement Confederation |
container_volume | 182 |
creator | Goyal, Bhawna Chyophel Lepcha, Dawa Dogra, Ayush Bhateja, Vikrant Lay-Ekuakille, Aimé |
description | •An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved.
Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition. |
doi_str_mv | 10.1016/j.measurement.2021.109663 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2569692533</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0263224121006321</els_id><sourcerecordid>2569692533</sourcerecordid><originalsourceid>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</originalsourceid><addsrcrecordid>eNqNkEFr3DAQhUVpodu0_0GlZ2-lkS2vjmVpmkBCLgn0JrTSKGixrVQjN6S_vgpbaI45DAMz7z14H2OfpdhKIfXX43ZGR2vBGZe6BQGy3Y3W6g3byN2oul7Cz7dsI0CrDqCX79kHoqMQQiujN-zP9X87d0to46YnSsRz5PM61dTNObiJp9ndI48rpbzwGWtJnvjBEQbeDlTL6mvL4e7RFVyQiDfpcs9Dnl1aeC1uoZjLzGOaKpb2-sjeRTcRfvq3z9jd-ffb_UV3dfPjcv_tqvMwmtoNCDi6fggHDRCMH72Jrh_1AdQw9BFHVACjALcL3njp49ArEQd12AXwTkR1xr6cch9K_rUiVXvMa2k1ycKgjTYwKNVU5qTyJRMVjPahtM7lyUphn1Hbo32B2j6jtifUzbs_ebHV-J2wWPIJF48hFfTVhpxekfIXJ1KROw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2569692533</pqid></control><display><type>article</type><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><source>Access via ScienceDirect (Elsevier)</source><creator>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</creator><creatorcontrib>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</creatorcontrib><description>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved.
Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</description><identifier>ISSN: 0263-2241</identifier><identifier>EISSN: 1873-412X</identifier><identifier>DOI: 10.1016/j.measurement.2021.109663</identifier><language>eng</language><publisher>London: Elsevier Ltd</publisher><subject>Complexity ; Computer vision ; Domain Transform Filtering ; Domains ; Fusion ; Image filters ; Image processing ; Image processing systems ; Image quality ; Image resolution ; Measurement ; Measurement of Fusion ; Medical diagnosis ; Medical Image Fusion for Diagnosis ; Medical imaging ; Physicians ; Quality assessment ; Rolling Guidance Filter ; SSE ; Studies ; Subjective Measurement & Analysis ; Sum rules ; Target recognition</subject><ispartof>Measurement : journal of the International Measurement Confederation, 2021-09, Vol.182, p.109663, Article 109663</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright Elsevier Science Ltd. Sep 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</citedby><cites>FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</cites><orcidid>0000-0003-0111-9612</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.measurement.2021.109663$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Goyal, Bhawna</creatorcontrib><creatorcontrib>Chyophel Lepcha, Dawa</creatorcontrib><creatorcontrib>Dogra, Ayush</creatorcontrib><creatorcontrib>Bhateja, Vikrant</creatorcontrib><creatorcontrib>Lay-Ekuakille, Aimé</creatorcontrib><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><title>Measurement : journal of the International Measurement Confederation</title><description>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved.
Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</description><subject>Complexity</subject><subject>Computer vision</subject><subject>Domain Transform Filtering</subject><subject>Domains</subject><subject>Fusion</subject><subject>Image filters</subject><subject>Image processing</subject><subject>Image processing systems</subject><subject>Image quality</subject><subject>Image resolution</subject><subject>Measurement</subject><subject>Measurement of Fusion</subject><subject>Medical diagnosis</subject><subject>Medical Image Fusion for Diagnosis</subject><subject>Medical imaging</subject><subject>Physicians</subject><subject>Quality assessment</subject><subject>Rolling Guidance Filter</subject><subject>SSE</subject><subject>Studies</subject><subject>Subjective Measurement & Analysis</subject><subject>Sum rules</subject><subject>Target recognition</subject><issn>0263-2241</issn><issn>1873-412X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNqNkEFr3DAQhUVpodu0_0GlZ2-lkS2vjmVpmkBCLgn0JrTSKGixrVQjN6S_vgpbaI45DAMz7z14H2OfpdhKIfXX43ZGR2vBGZe6BQGy3Y3W6g3byN2oul7Cz7dsI0CrDqCX79kHoqMQQiujN-zP9X87d0to46YnSsRz5PM61dTNObiJp9ndI48rpbzwGWtJnvjBEQbeDlTL6mvL4e7RFVyQiDfpcs9Dnl1aeC1uoZjLzGOaKpb2-sjeRTcRfvq3z9jd-ffb_UV3dfPjcv_tqvMwmtoNCDi6fggHDRCMH72Jrh_1AdQw9BFHVACjALcL3njp49ArEQd12AXwTkR1xr6cch9K_rUiVXvMa2k1ycKgjTYwKNVU5qTyJRMVjPahtM7lyUphn1Hbo32B2j6jtifUzbs_ebHV-J2wWPIJF48hFfTVhpxekfIXJ1KROw</recordid><startdate>202109</startdate><enddate>202109</enddate><creator>Goyal, Bhawna</creator><creator>Chyophel Lepcha, Dawa</creator><creator>Dogra, Ayush</creator><creator>Bhateja, Vikrant</creator><creator>Lay-Ekuakille, Aimé</creator><general>Elsevier Ltd</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-0111-9612</orcidid></search><sort><creationdate>202109</creationdate><title>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</title><author>Goyal, Bhawna ; Chyophel Lepcha, Dawa ; Dogra, Ayush ; Bhateja, Vikrant ; Lay-Ekuakille, Aimé</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c279t-5e2e7a45db622d9c7c9fa476b23554fe7e322702a8dc9c1cf5430f53b8d2ca0f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Complexity</topic><topic>Computer vision</topic><topic>Domain Transform Filtering</topic><topic>Domains</topic><topic>Fusion</topic><topic>Image filters</topic><topic>Image processing</topic><topic>Image processing systems</topic><topic>Image quality</topic><topic>Image resolution</topic><topic>Measurement</topic><topic>Measurement of Fusion</topic><topic>Medical diagnosis</topic><topic>Medical Image Fusion for Diagnosis</topic><topic>Medical imaging</topic><topic>Physicians</topic><topic>Quality assessment</topic><topic>Rolling Guidance Filter</topic><topic>SSE</topic><topic>Studies</topic><topic>Subjective Measurement & Analysis</topic><topic>Sum rules</topic><topic>Target recognition</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Goyal, Bhawna</creatorcontrib><creatorcontrib>Chyophel Lepcha, Dawa</creatorcontrib><creatorcontrib>Dogra, Ayush</creatorcontrib><creatorcontrib>Bhateja, Vikrant</creatorcontrib><creatorcontrib>Lay-Ekuakille, Aimé</creatorcontrib><collection>CrossRef</collection><jtitle>Measurement : journal of the International Measurement Confederation</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Goyal, Bhawna</au><au>Chyophel Lepcha, Dawa</au><au>Dogra, Ayush</au><au>Bhateja, Vikrant</au><au>Lay-Ekuakille, Aimé</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering</atitle><jtitle>Measurement : journal of the International Measurement Confederation</jtitle><date>2021-09</date><risdate>2021</risdate><volume>182</volume><spage>109663</spage><pages>109663-</pages><artnum>109663</artnum><issn>0263-2241</issn><eissn>1873-412X</eissn><abstract>•An Assistive medical diagnostic tool design is proposed.•Measurement and analysis of image fusion quality metrics.•Improved performance and striking visual quality is achieved.
Due to varrying imaging principles and interwined complexity of human organ structures, different types of medical images must be combined, as single-modality medical images may only provide limited information. In this paper, a multimodal medical image fusion method that integrates multimodal medical images having low resolution with reduced computational complexity to improve the accuracy of target recognition and for providing a basis for clinical diagnosis. Initially salient structure extraction (SSE) approach, which employ a rolling guidance filter (RGF) over the source images for removing small scale structures while preserving the image textures and thereby recovering the salient edges has been implemented. Subsequently image gradient operator is employed to restores large-scale structures from the filtered images. A DTF (Domain Transfer Filtering) is further used to recover the small-scale details in the neighborhood of large-scale structures of the images. The output of DTF is used as a weighted map that is combined with the source images to recover fusion result by a weighted-sum rule. Image fusion measurement for quality assessment and objective analysis is carried out using various fusion metrics. Experimental result shows that the proposed method can obtain high quantitative and qualitative performance as compared to other state-of-the-art methods and can eventually provide effective reference for doctors to assess patient condition.</abstract><cop>London</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.measurement.2021.109663</doi><orcidid>https://orcid.org/0000-0003-0111-9612</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0263-2241 |
ispartof | Measurement : journal of the International Measurement Confederation, 2021-09, Vol.182, p.109663, Article 109663 |
issn | 0263-2241 1873-412X |
language | eng |
recordid | cdi_proquest_journals_2569692533 |
source | Access via ScienceDirect (Elsevier) |
subjects | Complexity Computer vision Domain Transform Filtering Domains Fusion Image filters Image processing Image processing systems Image quality Image resolution Measurement Measurement of Fusion Medical diagnosis Medical Image Fusion for Diagnosis Medical imaging Physicians Quality assessment Rolling Guidance Filter SSE Studies Subjective Measurement & Analysis Sum rules Target recognition |
title | Measurement and analysis of multi-modal image fusion metrics based on structure awareness using domain transform filtering |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T20%3A33%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Measurement%20and%20analysis%20of%20multi-modal%20image%20fusion%20metrics%20based%20on%20structure%20awareness%20using%20domain%20transform%20filtering&rft.jtitle=Measurement%20:%20journal%20of%20the%20International%20Measurement%20Confederation&rft.au=Goyal,%20Bhawna&rft.date=2021-09&rft.volume=182&rft.spage=109663&rft.pages=109663-&rft.artnum=109663&rft.issn=0263-2241&rft.eissn=1873-412X&rft_id=info:doi/10.1016/j.measurement.2021.109663&rft_dat=%3Cproquest_cross%3E2569692533%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2569692533&rft_id=info:pmid/&rft_els_id=S0263224121006321&rfr_iscdi=true |