LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

Abstract

With the significant advancements of Deep Learning (DL) in the field of remote sensing imagery, a plethora of Change Detection (CD) methods based on CNNs, attention mechanisms, and transformers have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This paper is dedicated to integrating lightweight approaches into the CD task.We introduce a Lightweight Hybrid Dual-Attention CNN and Transformer network (LHDACT) based on Depthwise Over-Parameterized Convolution (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the Multi-Scale Average Pooling module (MSAP), ensuring global context with low computational overhead.To better discern regions of interest within complex images, we enhance the Dual Attention Module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. Lastly, we employ a compact transformer module to capture feature differences, enabling precise change detection CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.