Error resilient video coding via weighted distortion

Abstract

Conventional rate-distortion (RD) optimized video coding is formulated for an error-free environment. Special considerations have to be made when transmitting video in lossy networks. In this paper we demonstrate a novel method of weighting the distortion used for mode decisions and motion estimation in H.264. By determining an appropriate weighting factor, motion vectors are biased towards macroblocks (MB) that have less influence on the motion propagation path and mode decisions are made considering a MB's future impact. We therefore propose tracking the influence that each macroblock has along the motion propagation path to determine the weights. Considerable performance improvements are unveiled in comparison with state of the art robust video schemes.