Few-Shot Hyperspectral Image Classification Using Meta Learning and Regularized Finetuning

Abstract

The use of deep learning (DL) based hyperspectral image (HSI) classification has been made remarkable progress in recent years. However, obtaining sufficient labeled samples for training DL models remains a challenge. Transfer learning is effective in addressing the problem of HSI classification with limited labeled samples. However, cross-domain HSI classification using transfer learning remain difficult, as differences in ground object categories between two datasets make it challenging to transfer and learn accurate. To address this issue, we propose a simple yet effective method for HSI classification using Model-Agnostic Meta-Learning (MAML) and Regularized Fine-tuning (MRFSL). Our method uses optimized 3-Dimension Convolutional Neural Networks (3D-CNNs) model, aided by MAML and cutout data augmentation to enable cross-domain transfer learning and carry out the HSI classification with limited target samples. Experiments conducted on three HSI datasets demonstrate that the MRFSL method achieves excellent results compared to existing methods. Specifically, the overall accuracy of our proposed MRFSL method reached 91.81%, 71.04%, and 88.35%, when only five labeled samples for each category were randomly extracted from the Salinas, Indian Pines, and University of Pavia datasets, respectively.