Modelled Object Pose Estimation and Tracking by Monocular Vision

Abstract

This paper presents a new method that permits to solve the problem of determination of a modelled 3D-object spatial attitude from a single perspective image and to compute the covariance matrix associated to the attitude parameters. Its principle is based on the interpretation of at least three segments as the perspective projection of linear ridges of the object model and on the iterative search ( using Kalman filtering) of the model attitude consistent with these projections. The knowledge of the attitude and of the associated covariances enables to use a higher level Kalman filter to track an object along an image sequence. In the tracking process this Kalman filter is used to predict the attitude of the object and the error matrices are used to make robust automatic matches between the image segments and the model ridges. Tracking experiments have been made that proves the validity of this approach. This work has been partially supported by a contract with the European Spatial Agency (ESA) in which society Sagem is the prime contractor.