Visible and near infrared image fusion based on texture information

Abstract

In this paper, we proposed a novel visible and near-infrared image fusion (VIS-NIR fusion) method based on texture filter, aiming at the problems of artifact, color distortion and noise in traditional VIS-NIR fusion methods. Firstly, the structure information of the visible (VIS) image and the near infrared (NIR) image after texture removal is obtained by relative total variation (RTV) calculation as the base layer of the fused image; secondly, Secondly, the image noise weight is calculated by establishing a Bayesian classification model, and the noise information in the VIS information is adaptively filtered by joint bilateral filtering; finally, the fused image is acquired by color space conversion. The experimental results show that the proposed algorithm can preserve the spectral characteristics and the unique information of VIS and NIR images without artifacts and color distortion, and has good robustness as well as preserving the unique texture.