Target Tracking with Adaptive Morphological Correlation and Neural Predictive Modeling

Abstract

A tracking method based on adaptive morphological correlation and neural predictive models is presented. The morphological correlation filters are optimized according to the aggregated binary dissimilarity-to-matching ratio criterion and are adapted online to appearance variations of the target across frames. Morphological correlation filtering enables reliable detection and accurate localization of the target in the scene. Furthermore, trained neural models predict the target’s expected location in subsequent frames and estimate its bounding box from the correlation response. Effective stages for drift correction and tracker reinitialization are also proposed. Performance evaluation results for the proposed tracking method on four image datasets are presented and discussed using objective measures of detection rate (DR), location accuracy in terms of normalized location error (NLE), and region-of-support estimation in terms of intersection over union (IoU). The results indicate a maximum average performance of 90.1% in DR, 0.754 in IoU, and 0.004 in NLE on a single dataset, and 83.9%, 0.694, and 0.015, respectively, across all four datasets. In addition, the results obtained with the proposed tracking method are compared with those of five widely used correlation filter-based trackers. The results show that the suggested morphological-correlation filtering, combined with trained neural models, generalizes well across diverse tracking conditions.