Multiframe error concealment for MPEG-coded video delivery over error-prone networks

Abstract

Compressed video sequences are very vulnerable to channel disturbances when they are transmitted through an unreliable medium such as a wireless channel. Transmission errors not only corrupt the current decoded frame, but they may also propagate to succeeding frames. A number of post-processing error concealment (ECN) methods that exploit the spatial and/or temporal redundancy in the video signal have been proposed to combat channel disturbances. Although these approaches can effectively conceal lost or erroneous macroblocks (MBs), all of them only consider spatial and/or temporal correlation in a single frame (the corrupted one), which limits their ability to obtain an optimal recovery. Since the error propagates to the next few motion-compensated frames in the presence of lost MBs in an I or P frame, error concealment should simultaneously minimize the errors not only in the current decoded frame but also in the succeeding B and P frames that depend on the corrupted frame. We propose a novel multiframe recovery principle which analyzes the propagation of a lost MB into succeeding frames. Then, MPEG-compatible spatial and temporal error concealment approaches using this multiframe recovery principle are proposed, where the lost MBs are recovered in such a way that the error propagation is minimized.