Eigen-image based video segmentation and indexing

Abstract

We present a new approach for automatic video scene segmentation and content based indexing. Our approach detects video shots and builds a collection of key frames and representative frames. Scene segmentation and video indexing are based on a temporally windowed principal component analysis of a subsampled version of the video sequence. Two discriminants are derived from the principal components on a frame by frame basis. The discriminants are used for scene change detection and key frame extraction and classification into relevant clips. The system creates an adjacency matrix to build the scene transition graph. The scene transition graph allows easy access to video image-based information.