Image fusion module, fusion network and fusion method
An image fusion module comprises a modal weight network used for generating modal weights, a channel weight network used for generating channel weights, a weighted output network, an aggregation module and a feedback module connected with the aggregation module and an encoder, and the weighted outpu...
Gespeichert in:
Hauptverfasser: | , , , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | An image fusion module comprises a modal weight network used for generating modal weights, a channel weight network used for generating channel weights, a weighted output network, an aggregation module and a feedback module connected with the aggregation module and an encoder, and the weighted output network multiplies the modal weights and corresponding input modal features and then merges the modal weights and the corresponding input modal features. Multiplying by the channel weight; the aggregation module refines the weighted features; and the feedback module feeds back the fusion features to the encoder to guide the extraction of the modal features in the next stage. The invention further discloses an image fusion network and an image fusion method. According to the image fusion module network and the fusion method, the weight is decomposed into the modal weight and the channel weight, multi-modal data are fused, and compared with the prior art, the image fusion module network and the fusion method can fo |
---|