Hybrid Attention-Aware Transformer Network Collaborative Multiscale Feature Alignment for Building Change Detection

Abstract

Building change detection (BCD) is essential for urban dynamic measurement. Deep learning has demonstrated significant potential in image processing, providing powerful feature extraction capabilities for BCD tasks. However, existing methods do not adequately mine multiscale feature information and ignore the importance of multiscale feature alignment, leading to an inadequate representation of the internal structure. Therefore, we propose a hybrid attention-aware Transformer network (HATNet) designed to effectively extract and interact with multiscale context information. Specifically, HATNet first incorporates a hybrid attention-aware feature extractor (HAFE) module that integrates self-attention (SA) and coordinate-attention (CA) to effectively extract complementary multiscale features. The SA establishes long-range dependencies between multiscale features, while the CA captures spatial dependencies and preserves positional details. Then, we devise a building saliency detection enhancement (BSDE) module that utilizes three independent channels to facilitate the identification and localization of changed buildings, fostering a symbiotic relationship between unchanged and changed areas. Furthermore, we adopt a coarse-to-fine feature interaction (CFFI) module to progressively fuse multiscale features using a hierarchical strategy. In order to better locate the changed detail features, we introduce a global feature alignment (GFA) module to achieve global multiscale feature alignment. HATNet surpasses eight BCD methods on LEVIR-CD, WHU-CD, and S2Looking-CD datasets. The experimental results provide compelling evidence of our method to precisely detect and measure building changes. The codes are available at https://github.com/yzygit1230/HATNet.