FusionGCN: Multi-focus image fusion using superpixel features generation GCN and pixel-level feature reconstruction CNN

In recent years, convolutional neural networks have demonstrated significant advancements in the domain of computer vision, effectively addressing numerous previously challenging issues. An increasing number of researchers are focusing their investigations on this field, proposing innovative network...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Expert systems with applications 2025-03, Vol.262, p.125665, Article 125665
Hauptverfasser: Ouyang, Yuncan, Zhai, Hao, Hu, Hanyue, Li, Xiaohang, Zeng, Zhi
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In recent years, convolutional neural networks have demonstrated significant advancements in the domain of computer vision, effectively addressing numerous previously challenging issues. An increasing number of researchers are focusing their investigations on this field, proposing innovative network architectures. However, many existing networks necessitate intricate module designs and a substantial number of parameters to achieve satisfactory fusion outcomes, which poses challenges for lightweight devices with constrained computational resources. To mitigate this concern, the present study introduces a novel methodology that integrates block segmentation with pixel optimization. Specifically, we initially employ graph convolutional networks to execute flexible convolutions on large-scale, irregular regions generated through superpixel clustering, thereby achieving coarse segmentation at the block level. Subsequently, we utilize parallel lightweight convolutional networks to provide pixel-level guidance, ultimately resulting in a more accurate decision map. Furthermore, to leverage the strengths of both networks and facilitate the optimization of feature generation from the graph convolutional network for non-Euclidean data, we meticulously design a superpixel-based graph decoder alongside a pixel-based convolutional neural network extraction block to enhance feature acquisition and propagation. In comparison to numerous state-of-the-art methodologies, our approach demonstrates commendable competitiveness in both qualitative and quantitative analyses, as well as in efficiency evaluations. The code can be downloaded at https://github.com/ouyangbaicai/FusionGCN. •To our knowledge, this is the first time that GCN has been used to solve the problem of multi focus image fusion.•Compared with existing methods, FusionGCN provides a new solution for multi focus image fusion tasks running on devices with limited computing resources.•FusionGCN has achieved good results on multiple datasets.
ISSN:0957-4174
DOI:10.1016/j.eswa.2024.125665