Multi-Target Tracking Based on High-Order Appearance Feature Fusion

Abstract

Multi-target tracking (MTT) is among the fundamental problems in the field of video analysis and monitoring. In the tracking-by-detection framework, data association is one of the most important and difficult problems. In this paper, we propose a framework to obtain the appearance features of a target in an end-to-end fashion, which fuses high-level and low-level semantic information. The high-order feature map is abstracted using the high-order apparent relationship for each target between the current frame and the previous frames, whereas the similarity matrix is used to describe the high-order features of the target. The best matching relationships between targets are obtained using hierarchical data association and the Hungarian algorithm. This proposed method is called Multi-target tracking Based on High-order Appearance Feature Fusion (MTT-HAFF), which can handle a large number of input sequences, local association failures, and identity exchanges that result from unreliable detections. The results show that the proposed algorithm has a good robustness for long-term occlusion tracking.