Multi-view Image Color Consistency Enhancement using 3D Point Cloud Registration

Abstract

Color inconsistency in multi-view images degrades the performance of various consumer electronics applications that use multi-view images, such as panoramic image stitching and 3D reconstruction for VR contents. In this paper, a novel approach to multi-view image color consistency enhancement is proposed. In contrast to conventional methods that try to find a nonlinear transfer function for each color channel, in the proposed method, the color distribution of the source image is non-rigidly transformed into that of the reference image using a 3D point set registration algorithm. In order to significantly reduce the computation of the 3D registration process, representative color points are utilized for the 3D registration instead of all the pixel color points. The number of representatives is much less than the number of image pixels, but they effectively approximate the color distribution of the image. Through extensive experiments, we show that the proposed method outperforms conventional methods in color consistency enhancement both subjectively and objectively, and the proposed representative color point set approximation improves the computational efficiency.