Semi-supervised Medical Image Segmentation with Semantic Distance Distribution Consistency Learning
Pages 323 - 335
Abstract
Semi-supervised medical image segmentation has attracted much attention due to the alleviation of expensive annotations. Recently, many existing semi-supervised methods incorporate unlabeled data via the consistency learning. However, those consistency learning methods usually utilize the mean teacher structure, resulting in the different feature distribution on the intermediate representations. As for semi-supervised medical image segmentation, the different feature distribution limits the efficiency of consistency. In this paper, we propose Semantic Distance Distribution (SDD) Consistency Learning method, which has the ability to maintain the same feature distribution on the intermediate representations. On the one hand, to model invariance on feature distribution, we consider the shared encoder instead of averaging model weights. On the other hand, we introduce a SDD Map for consistency learning on the intermediate representations, where SDD Map is closely related to the feature distribution. SDD Map is characterized with the set of distances between the feature on each voxel and the mean value of all features in intra-cluster. Extensive experiments on two popular medical datasets have demonstrated our proposed method achieves state-of-the-art results.
References
[1]
Bearman A, Russakovsky O, Ferrari V, and Fei-Fei L Leibe B, Matas J, Sebe N, and Welling M What’s the point: semantic segmentation with point supervision Computer Vision – ECCV 2016 2016 Cham Springer 549-565
[2]
Bortsova G, Dubost F, Hogeweg L, Katramados I, de Bruijne M, et al. Shen D et al. Semi-supervised medical image segmentation via learning consistency under transformations Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 810-818
[3]
Chen, X., He, K.: Exploring simple siamese representation learning. In: Conference on Computer Vision and Pattern Recognition (2021)
[4]
French, G., Laine, S., Aila, T., Mackiewicz, M., Finlayson, G.: Semi-supervised semantic segmentation needs strong, varied perturbations. In: British Machine Vision Conference (2020)
[5]
Hang W et al. Local and global structure-aware entropy regularized mean teacher model for 3D left atrium segmentation Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 562-571
[6]
Laine, S., Aila, T.: Temporal ensembling for semi-supervised learning. In: International Conference on Learning Representations (2017)
[7]
Li S, Zhang C, He X, et al. Martel AL et al. Shape-aware semi-supervised 3D semantic segmentation for medical images Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 552-561
[8]
Li, X., Yu, L., Chen, H., Fu, C.W., Heng, P.A.: Semi-supervised skin lesion segmentation via transformation consistent self-ensembling model. In: British Machine Vision Conference (2018)
[9]
Luo, X., Chen, J., Song, T., Chen, Y., Wang, G., Zhang, S.: Semi-supervised medical image segmentation through dual-task consistency. In: AAAI Conference on Artificial Intelligence (2021)
[10]
Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: International Conference on 3D Vision, pp. 565–571 (2016)
[11]
Ouali, Y., Hudelot, C., Tami, M.: Semi-supervised semantic segmentation with cross-consistency training. In: Conference on Computer Vision and Pattern Recognition, pp. 12674–12684 (2020)
[12]
Perone, C.S., Cohen-Adad, J.: Deep semi-supervised segmentation with weight-averaged consistency targets. In: Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pp. 12–19 (2018)
[13]
Ronneberger O, Fischer P, and Brox T Navab N, Hornegger J, Wells WM, and Frangi AF U-Net: convolutional networks for biomedical image segmentation Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 2015 Cham Springer 234-241
[14]
Shen H, Wang R, Zhang J, McKenna SJ, et al. Descoteaux M et al. Boundary-aware fully convolutional network for brain tumor segmentation Medical Image Computing and Computer-Assisted Intervention – MICCAI 2017 2017 Cham Springer 433-441
[15]
Tarvainen, A., Valpola, H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Neural Information Processing Systems, pp. 1195–1204 (2017)
[16]
Wang Y, et al., et al. Martel AL, et al., et al. Double-uncertainty weighted method for semi-supervised learning Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 542-551
[17]
Xiong Z, Fedorov VV, Fu X, Cheng E, Macleod R, and Zhao J Fully automatic left atrium segmentation from late gadolinium enhanced magnetic resonance imaging using a dual fully convolutional neural network IEEE Trans. Med. Imaging 2019 38 2 515-524
[18]
Yu L, Wang S, Li X, Fu C-W, Heng P-A, et al. Shen D et al. Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 605-613
[19]
Zheng H, et al., et al. Shen D, et al., et al. Semi-supervised segmentation of liver using adversarial learning with deep atlas prior Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 148-156
[20]
Zhou Z, Siddiquee MMR, Tajbakhsh N, and Liang J Unet++: redesigning skip connections to exploit multiscale features in image segmentation IEEE Trans. Med. Imaging 2019 39 6 1856-1867
Index Terms
- Semi-supervised Medical Image Segmentation with Semantic Distance Distribution Consistency Learning
Index terms have been assigned to the content through auto-classification.
Recommendations
Pair Shuffle Consistency for Semi-supervised Medical Image Segmentation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024AbstractSemi-supervised medical image segmentation is a practical but challenging problem, in which only limited pixel-wise annotations are available for training. While most existing methods train a segmentation model by using the labeled and unlabeled ...
Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations
Medical Image Computing and Computer Assisted Intervention – MICCAI 2019AbstractThe scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and unlabeled ...
Uncertainty-guided mutual consistency learning for semi-supervised medical image segmentation
AbstractMedical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring expert-...
Highlights- A novel uncertainty-guided mutual consistency learning framework is proposed for semi-supervised medical image segmentation to alleviate the heavy burden of ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2022
736 pages
ISBN:978-3-031-18909-8
DOI:10.1007/978-3-031-18910-4
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2022.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 14 October 2022
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025