An attention based method for video semantic segmentation

Abstract

OSVOS is one of the best algorithms in video semantic segmentation of single-target. CBAM module is proposed in object detection and classification. This module can improve the performance of the network without adding extra computation. In view of this, this paper proposes an end-to-end network AttnVSS based on attention and VGG-16. CBAM is embedded in the shallow layer of our network. The network is first pre-trained on ImageNet, and then full connection layer is removed and fine-tuned to meet the segmentation requirements. Through the ablation experiment on DAVIS dataset, it is proved that CBAM can be embedded into semantic segmentation networks. At the same time, it can help the network to allocate "attention", focus on the most meaningful part of the input, to achieve faster and more accurate segmentation.