Event clustering of consumer pictures using foreground/background segmentation

Abstract

This paper describes a new algorithm to classify consumer photographs into different events when date and time information is not available. Without any information about the context of the pictures, we have to rely on the image content. Our approach involves using an efficient segmentation scheme and extraction of low-level features to detect event boundaries. Specifically, we have developed a foreground/background segmentation algorithm based on block-based clustering. This block segmentation provides less precision, but still gives good results with low computation cost. A third-party ground truth database has been created with the help of the Human Factors Laboratory at Kodak, to benchmark our approaches. Based on these results, we concluded that a simple block-based segmentation scheme performed better than the original block-based event clustering algorithm without segmentation. We believe that many improvements, especially on segmentation and feature extraction, should lead to better results in the future.