Bayesian relevance feedback for content-based image retrieval

Abstract

We present a Bayesian learning algorithm that relies on belief propagation to integrate feedback provided by the user over a retrieval session. Bayesian retrieval leads to a natural criteria for evaluating local image similarity without requiring any image segmentation. This allows the practical implementation of retrieval systems where users can provide image regions, or objects, as queries. Region-based queries are significantly less ambiguous than queries based on entire images leading to significant improvements in retrieval precision. When combined with local similarity, Bayesian belief propagation is a powerful paradigm for user interaction. Experimental results show that significant improvements in the frequency of convergence to the relevant images can be achieved by the inclusion of learning in the retrieval process.