Consistency-Guided Meta-learning for Bootstrapping Semi-supervised Medical Image Segmentation
Authors: 
Qingyue Wei, Lequan Yu, Xianhang Li, Wei Shao, Cihang Xie, Lei Xing, Yuyin ZhouAuthors Info & Claims
Pages 183 - 193
Abstract
Medical imaging has witnessed remarkable progress but usually requires a large amount of high-quality annotated data which is time-consuming and costly to obtain. To alleviate this burden, semi-supervised learning has garnered attention as a potential solution. In this paper, we present Meta-Learning for Bootstrapping Medical Image Segmentation (MLB-Seg), a novel method for tackling the challenge of semi-supervised medical image segmentation. Specifically, our approach first involves training a segmentation model on a small set of clean labeled images to generate initial labels for unlabeled data. To further optimize this bootstrapping process, we introduce a per-pixel weight mapping system that dynamically assigns weights to both the initialized labels and the model’s own predictions. These weights are determined using a meta-process that prioritizes pixels with loss gradient directions closer to those of clean data, which is based on a small set of precisely annotated images. To facilitate the meta-learning process, we additionally introduce a consistency-based Pseudo Label Enhancement (PLE) scheme that improves the quality of the model’s own predictions by ensembling predictions from various augmented versions of the same input. In order to improve the quality of the weight maps obtained through multiple augmentations of a single input, we introduce a mean teacher into the PLE scheme. This method helps to reduce noise in the weight maps and stabilize its generation process. Our extensive experimental results on public atrial and prostate segmentation datasets demonstrate that our proposed method achieves state-of-the-art results under semi-supervision. Our code is available at https://github.com/aijinrjinr/MLB-Seg.
References
[1]
Adiga Vasudeva S, Dolz J, and Lombaert H Wang L, Dou Q, Fletcher PT, Speidel S, and Li S Leveraging labeling representations in uncertainty-based semi-supervised segmentation Medical Image Computing and Computer Assisted Intervention 2022 Cham Springer 265-275
[2]
Bachman, P., Alsharif, O., Precup, D.: Learning with pseudo-ensembles. In: Advances in Neural Information Processing Systems, vol. 27 (2014)
[3]
Berthelot, D., Carlini, N., Goodfellow, I., Papernot, N., Oliver, A., Raffel, C.A.: MixMatch: a holistic approach to semi-supervised learning. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
[4]
Chen C, Bai W, Rueckert D, et al. Pop M et al. Multi-task learning for left atrial segmentation on GE-MRI Statistical Atlases and Computational Models of the Heart. Atrial Segmentation and LV Quantification Challenges 2019 Cham Springer 292-301
[5]
Hang W, et al., et al. Martel AL, et al., et al. Local and global structure-aware entropy regularized mean teacher model for 3D left atrium segmentation Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 562-571
[6]
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
[7]
Lee, D.H., et al.: Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on Challenges in Representation Learning, ICML, vol. 3, p. 896 (2013)
[8]
Li S, Zhang C, He X, et al. Martel AL et al. Shape-aware semi-supervised 3D semantic segmentation for medical images Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 552-561
[9]
Litjens G et al. Evaluation of prostate segmentation algorithms for MRI: the PROMISE12 challenge Med. Image Anal. 2014 18 2 359-373
[10]
Liu, F., Tian, Y., Chen, Y., Liu, Y., Belagiannis, V., Carneiro, G.: ACPL: anti-curriculum pseudo-labelling for semi-supervised medical image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20697–20706 (2022)
[11]
Luo, X., Chen, J., Song, T., Wang, G.: Semi-supervised medical image segmentation through dual-task consistency. arXiv preprint arXiv:2009.04448 (2020)
[12]
Masood S, Sharif M, Masood A, Yasmin M, and Raza M A survey on medical image segmentation Curr. Med. Imaging 2015 11 1 3-14
[13]
Peng, J., Wang, P., Desrosiers, C., Pedersoli, M.: Self-paced contrastive learning for semi-supervised medical image segmentation with meta-labels. In: Advances in Neural Information Processing Systems, vol. 34 (2021)
[14]
Reed, S., Lee, H., Anguelov, D., Szegedy, C., Erhan, D., Rabinovich, A.: Training deep neural networks on noisy labels with bootstrapping. arXiv preprint arXiv:1412.6596 (2014)
[15]
Ren, M., Zeng, W., Yang, B., Urtasun, R.: Learning to reweight examples for robust deep learning. In: International Conference on Machine Learning, pp. 4334–4343. PMLR (2018)
[16]
Ronneberger O, Fischer P, and Brox T Navab N, Hornegger J, Wells WM, and Frangi AF U-Net: convolutional networks for biomedical image segmentation Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 2015 Cham Springer 234-241
[17]
Tarvainen, A., Valpola, H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
[18]
Wang Y, et al., et al. Martel AL, et al., et al. Double-uncertainty weighted method for semi-supervised learning Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 2020 Cham Springer 542-551
[19]
Wu Y, Wu Z, Wu Q, Ge Z, and Cai J Wang L, Dou Q, Fletcher PT, Speidel S, and Li S Exploring smoothness and class-separation for semi-supervised medical image segmentation Medical Image Computing and Computer Assisted Intervention 2022 Cham Springer 34-43
[20]
Wu Y, Xu M, Ge Z, Cai J, Zhang L, et al. de Bruijne M et al. Semi-supervised left atrium segmentation with mutual consistency training Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 2021 Cham Springer 297-306
[21]
Xiang J, Qiu P, and Yang Y Wang L, Dou Q, Fletcher PT, Speidel S, and Li S FUSSNet: fusing two sources of uncertainty for semi-supervised medical image segmentation Medical Image Computing and Computer Assisted Intervention 2022 Cham Springer 481-491
[22]
Yu L, Wang S, Li X, Fu C-W, Heng P-A, et al. Shen D et al. Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 605-613
[23]
Zhao X, Wu Y, Song G, Li Z, Zhang Y, and Fan Y A deep learning model integrating FCNNs and CRFs for brain tumor segmentation Med. Image Anal. 2018 43 98-111
[24]
Zheng H, et al., et al. Shen D, et al., et al. Semi-supervised segmentation of liver using adversarial learning with deep atlas prior Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 148-156
[25]
Zhou, Y., et al.: Learning to bootstrap for combating label noise. arXiv preprint arXiv:2202.04291 (2022)
[26]
Zhou Z, Rahman Siddiquee MM, Tajbakhsh N, Liang J, et al. Stoyanov D et al. UNet++: a nested U-Net architecture for medical image segmentation Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support 2018 Cham Springer 3-11
Recommendations
Pair Shuffle Consistency for Semi-supervised Medical Image Segmentation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024AbstractSemi-supervised medical image segmentation is a practical but challenging problem, in which only limited pixel-wise annotations are available for training. While most existing methods train a segmentation model by using the labeled and unlabeled ...
Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations
Medical Image Computing and Computer Assisted Intervention – MICCAI 2019AbstractThe scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and unlabeled ...
Uncertainty-guided mutual consistency learning for semi-supervised medical image segmentation
AbstractMedical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring expert-...
Highlights- A novel uncertainty-guided mutual consistency learning framework is proposed for semi-supervised medical image segmentation to alleviate the heavy burden of ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2023
837 pages
ISBN:978-3-031-43900-1
DOI:10.1007/978-3-031-43901-8
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 08 October 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025