HSIRMamba: An effective feature learning for hyperspectral image classification using residual Mamba
Deep learning models have recently demonstrated outstanding results in classifying hyperspectral images (HSI). The Transformer model is among the various deep learning models that have received increasing interest due to its superior ability to simulate the long-term dependence of spatial-spectral i...
Gespeichert in:
Veröffentlicht in: | Image and vision computing 2025-02, Vol.154, p.105387, Article 105387 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Deep learning models have recently demonstrated outstanding results in classifying hyperspectral images (HSI). The Transformer model is among the various deep learning models that have received increasing interest due to its superior ability to simulate the long-term dependence of spatial-spectral information in HSI. Due to its self-attention mechanism, the Transformer exhibits quadratic computational complexity, which makes it heavier than other models and limits its application in the processing of HSI. Fortunately, the newly developed state space model Mamba exhibits excellent computing effectiveness and achieves Transformer-like modeling capabilities. Therefore, we propose a novel enhanced Mamba-based model called HSIRMamba that integrates residual operations into the Mamba architecture by combining the power of Mamba and the residual network to extract the spectral properties of HSI more effectively. It also includes a concurrent dedicated block for spatial analysis using a convolutional neural network. HSIRMamba extracts more accurate features with low computational power, making it more powerful than transformer-based models. HSIRMamba was tested on three majorly used HSI Datasets-Indian Pines, Pavia University, and Houston 2013. The experimental results demonstrate that the proposed method achieves competitive results compared to state-of-the-art methods.
•A new deep learning model integrates a lightweight CNN for local feature extraction and Mamba for long-range feature extraction with computational efficiency to facilitate efficient and effective HSIC.•Improved Mamba using the residual connection is introduced to mitigate vanishing gradient and overfitting and enhance feature integration.•Bidirectional spectral processing ensures comprehensive feature representation by leveraging the entire spectral range.•The proposed HSIRMamba outperformed state-of-the-art methods on three popular HSI datasets, namely Indian Pines, Pavia University, and Houston 2013. |
---|---|
ISSN: | 0262-8856 |
DOI: | 10.1016/j.imavis.2024.105387 |