RGB-infrared fusion tracking algorithm based on Siamese network

Abstract

The target tracking method based on RGB image is affected by many factors such as light and haze weather, so it is difficult to distinguish the tracking target from the background, and it is easy to lead to the drift or even loss of the tracking target. Target tracking based on infrared images is not affected by light, haze and other illumination factors, but the target's color, texture and other characteristic information will be missing. Therefore, in order to obtain the target's color, texture and other characteristic information in a poorly illuminated environment, while achieving accurate and fast tracking of the object, this paper proposes a RGB and infrared image fusion tracking method based on a deep convolutional network. Firstly, the fusion method of RGB and infrared images is studied; secondly, a target tracking network based on the Siamese network is established to extract the image convolution features of the target template and the current target; finally, the response map is calculated by the deep cross-correlation module. At last, the performance test of the target tracking algorithm is carried out on the VOT2019RGBT data set. Experimental results show that the algorithm can effectively solve the problem of target tracking when the target is partially occluded, the tracking scene has no suitable illumination or the light changes strongly, and it is of great significance to improve the accuracy of target tracking under complex backgrounds.