Multiview Calibrated Prototype Learning for Few-Shot Hyperspectral Image Classification

Abstract

Despite continuing to progress in hyperspectral image classification (HSIC) based on deep learning, the classification accuracy is limited to furtherly improve in the absence of labeled samples. To address this issue, the metric-based prototypical networks for few-shot learning have enjoyed widespread popularity. However, the conventional prototypical networks are vulnerable to the selected examples and fail to accomplish representative predictions for the prototypes in complicated situations. In this paper, we propose a multi-view calibrated prototype-learning framework for few-shot HSIC, which consists of three rectified strategies from different views to improve the robustness of prototypes in the embedding space. Specifically, the calibrated aggregation network is the first presented to calibrate the representations with local patches aggregation for the enhancement of the prototypes. Moreover, to improve the compactness of the intraclass expression, the calibrated metric learning with regularization terms is designed to strengthen the discrimination of the prototypes. Furthermore, we calibrate the feature distribution of supervised samples by transferring statistical knowledge to eliminate the local bias in the test phase. The extensive experimental results and analysis of three hyperspectral image datasets demonstrate the superiority of the proposed architecture compared with other advanced methods.