Dual-Attention-Driven Multiscale Fusion Object Searching Network for Remote Sensing Imagery

Abstract

Object search is a challenging yet important task. Many efforts have been made to address this issue and achieve great progress in natural image, yet searching all the specified types of objects from remote sensing image is barely studied. In this article, we are interested in searching objects from remote sensing images. Compared to person search in natural scenes, this task is challenging in two factors: One is that remote image usually contains a large number of objects, which poses a great challenge to characterize the object features; another is that the objects in remote sensing images are dense, which easily yield erroneous localization. To address these issues, we propose a new end-to-end deep learning framework for object search in remote sensing images. First, we propose a multiscale feature aggregation module, which strengthens the representation of low-level features by fusing multilayer features. The fused features with richer details significantly improve the accuracy of object search. Second, we propose a dual-attention object enhancement module to enhance features from channel and spatial dimensions. The enhanced features significantly improve the localization accuracy for dense objects. Finally, we built two challenging datasets based on the remote sensing images, which contain complex changes in space and time. The experiments and comparisons demonstrate the state-of-the-art performance of our method on the challenging datasets.