Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution

Abstract

Image super-resolution (SR) methods can generate remote sensing images with high spatial resolution without increasing the cost of acquisition equipment, thereby providing a feasible way to improve the quality of remote sensing images. Clearly, image SR is a severe ill-posed problem. With the development of deep learning, the powerful fitting ability of deep neural networks has solved this problem to some extent. Since the texture information of various remote sensing images are totally different from each other, in this paper, we proposed a network based on generative adversarial network (GAN) to achieve high resolution remote sensing images, named multi-attention generative adversarial network (MA-GAN). The main body of the generator in MA-GAN contains three blocks: pyramid-convolutional residualdense (PCRD) block, attention-based upsampling (AUP) block and attention-based fusion (AF) block. Specifically, the developed attention-pyramid convolutional (AttPConv) operator in PCRD block combines multi-scale convolution and channel attention (CA) to automatically learn and adjust the scale of residuals for better representation. The established AUP block utilizes pixel attention (PA) to perform arbitrary scales of upsampling. And the AF block employs branch attention (BA) to integrate upsampled low-resolution images with high-level features. Besides, the loss function takes both adversarial loss and feature loss into consideration to guide the learning procedure of generator. We have compared our MA-GAN approach with several state-of-the-art methods on a number of remote sensing scenes, and experimental results consistently demonstrate the effectiveness of the proposed MA-GAN. For study replication, the source code will be released at: https://github.com/ZhihaoWang1997/MA-GAN.