Shape-aware Multi-task Learning for Semi-supervised 3D Medical Image Segmentation

Abstract

Semi-supervised learning has achieved many successes in medical image segmentation since it reduces the costs of manually annotating by leveraging abundant unlabeled data. However, these semi-supervised methods lack attention to ambiguous regions (e.g., some edges or corners around the targets), which may lead to meaningless and unreliable guidance. In this paper, we propose a novel semi-supervised segmentation method called Shape-aware Multi-task Learning (SMTL) to address the above issue. Our multi-task framework includes three tasks namely i) the main task for segmentation ii) one auxiliary task for signed distance regression iii) another auxiliary task for contour detection. The multi-task framework jointly predicts probabilistic segmentation maps, signed distance maps (SDMs) and edge maps to collect complementary information in the existing target label. Specifically, these two auxiliary tasks explicitly enforce shape-priors on the segmentation output to generate more accurate masks. Moreover, we design a region-attention-based adversarial learning strategy that enforces the consistency of two auxiliary tasks prediction distributions on the unlabeled and labeled data to make a meaningful and reliable guidance. We evaluate our SMTL on the datasets of the 2018 Atrial Segmentation Challenge and the 2017 Liver Tumor Segmentation Challenge. The results demonstrate that our SMTL achieves improvements and outperforms the state-of-the-art semi-supervised methods.