Multiscale residual weakly dense network with attention mechanism for hyperspectral image classification

Abstract

Hyperspectral image (HSI) classification is a procedure of interest in remote sensing. HSIs contain complex spectral and spatial information, so classification tasks remain difficult. Although current deep-learning models have made significant progress in HSI classification, dealing with spectral and spatial information still requires careful investigation. To better manage spectral and spatial information and improve classification accuracy, we introduce a multiscale residual weakly dense network with an attention mechanism. First, we designed two residual weakly dense (Res-WDens) branches to extract spectral and spatial feature information and then applied the Concat method to fuse the two kinds of information. We also designed a plug-and-play hybrid attention module to refine the fused information so the network could focus on the essential spectral and spatial features. Finally, considering the relevance of spectral and spatial information, a dual-channel multiscale feature extraction module was used to extract the spectral–spatial multiscale information of HSIs. The overall accuracies of our proposed method reached 99.76%, 99.97%, and 100% on three publicly available datasets. A series of experiments demonstrated that our method is comparable to current state-of-the-art methods.