Partial Domain Adaptation on Semantic Segmentation

Abstract

The research of semantic segmentation based on unsupervised domain adaptation greatly alleviates the high-cost bottleneck of manual annotation in deep learning. Inevitably domain gap limits the ability of target domain to learn knowledge from source domain. Previous domain alignment strategies aim to explore maximum domain-invariant space to enlarge knowledge that target domain learns. They based on the assumption that images are symmetrical in categories covering all predefined categories. However, in practical training, there is class asymmetry in image samples inter domains. This will lead to outlier categories and negative transfer, because it lacks the guidance of the corresponding category of the source domain. To tackle this issue, we propose a partial domain adaptive method on semantic segmentation to guide target model to learn category-level knowledge selectively. PAM (Partial Adaptive Map) module is introduced to motivate the target model to obtain more knowledge from non-outliers and less knowledge from outliers to avoid negative transfer. We further analyze the effectiveness of this method from the perspective of JS divergence. Our method has achieved significant improvement without additional discriminators. Experiments on general datasets GTA5 and SYNTHIA can compare with SOTA methods.