Deep Fusion of Localized Spectral Features and Multi-scale Spatial Features for Effective Classification of Hyperspectral Images

•Band-grouping based spectral-spatial CNN deep learning for HSI classification•Localized spectra feature extraction for improved mining of sub hyper-cubes•Multiscale spatial feature extraction via hierarchical atrous spatial pyramid pooling This study presents a deep extraction of localized spectral features and multi-scale spatial features convolution (LSMSC) framework for spectral-spatial fusion based classification of hyperspectral images (HSIs). First, adjacent spectral bands are grouped based on their similarity measurements, where the whole hypercube is partitioned into several sub-cubes, each corresponding to one band group. Then, the proposed localized spectral features extraction (LSF) strategy is used to extract localized spectral features, which are extracted from each band group using the 1D convolutional neural network (CNN). Meanwhile, the proposed HiASPP strategy is employed to extract the multi-scale features from the first several principal components of each sub-cube. Finally, the extracted spectral and spatial features are concatenated for spectral-spatial fusion based classification of HSI. Experiments conducted on three publicly available datasets have demonstrated that the proposed architecture outperforms several state-of-the-art approaches.