Hyperspectral Image Classification Based on Spectral–Spatial Attention Tensor Network

Abstract

As an essential task in remote sensing, hyperspectral image classification (HSIC) has been extensively studied. Although many methods based on deep learning have been inducted to improve the performance of HSIC, they still face two challenges: 1) Can the joint spectral–spatial information in the hyperspectral image (HSI) be effectively utilized? 2) Does each pixel in a certain sample contribute equally to classification? We exploit a spectral–spatial attention tensor network (SSATN) in this letter, where the coordinate attention (CA) mechanism is first introduced into a full tensor network. We present a learnable tensor squeezing projection layer (TSPL) instead of the classical pooling layer for the CA block, which enables the network to selectively focus on discriminative features in spectral and spatial. Besides, the SSATN accepts raw HSI data as the input without dimensionality reduction in advance. Compared with the state-of-the-art convolutional neural network (CNN) methods, SSATN can effectively capture certain spectral–spatial features via tensor transformation with fewer parameters. The experimental results on two widely used HSI datasets prove the advantage of the SSATN method.