ER-Swin: Feature Enhancement and Refinement Network Based on Swin Transformer for Semantic Segmentation of Remote Sensing Images

Abstract

As the field of remote sensing images processing continues to advance, semantic segmentation has become a focal point in this domain. The emergence of Swin Transformer has greatly alleviated the computational complexities associated with Transformers, leading to its widespread application in the field of semantic segmentation. However, most current network models lack a feature enhancement process internally, and the model's tail lacks refinement modules to prevent category misjudgments caused by feature redundancy. To address this issue, we propose ER-Swin to explore the potential of utilizing Swin Transformer as the backbone network for semantic segmentation in remote sensing images. Addressing the need for feature enhancement in the backbone network, we propose the Interactive Feature Enhancement Attention (IFEA), which leverages diagonal information interaction to augment features. Additionally, we design the Semantic Selective Refinement Module (SSRM) to refine the rich features at the tail end of the network, thereby enhancing segmentation outcomes. We evaluate our model on the Vaihingen, Potsdam and LoveDA datasets, and achieved accuracies of 84.89%, 87.20%, and 55.1% on the mIoU metric. Through comparative experiments, we demonstrate the superior segmentation performance of our model, affirming its competitivenes.