Multiple Face Recognition from Omnidirectional Video

Abstract

Meetings are an integral part of business life. In previous work, we have developed a physical awareness system called CAMEO (Camera Assisted Meeting Event Observer) to record and process audio/visual information of a meeting. A very important task in meeting understanding is to know who is attending to the meeting and CAMEO's task is to infer people's identity from video. In this paper, we present an approach to identify people from an omnidirectional video sequence. Two main novelties are proposed: First a new dimensionality reduction technique MODA (Multimodal Oriented Discriminant Analysis) is used to perform fast matching and second we show that using multiple spatiotemporal constraints the recognition performance greatly improves. The effectiveness and robustness of the proposed system is demonstrated over several real time experiments and a large data set of videos.