Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1007/978-3-031-72114-4_2guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

A Curvature-Guided Coarse-to-Fine Framework for Enhanced Whole Brain Segmentation

Published: 07 October 2024 Publication History

Abstract

Whole brain segmentation, which divides the entire brain volume into anatomically labeled regions of interest (ROIs), is a crucial step in brain image analysis. Traditional methods often rely on intricate pipelines that, while accurate, are time-consuming and require expertise due to their complexity. Alternatively, end-to-end deep learning methods offer rapid whole brain segmentation but often sacrifice accuracy due to neglect of geometric features. In this paper, we propose a novel framework that integrates the key curvature feature, previously utilized by complex surface-based pipelines but overlooked by volume-based methods, into deep neural networks, thereby achieving both high accuracy and efficiency. Specifically, we first train a coarse anatomical segmentation model focusing on high-contrast tissue types, i.e., white matter (WM), gray matter (GM), and subcortical regions. Next, we reconstruct the cortical surfaces using the WM/GM interface and compute curvature features for each vertex on the surfaces. These curvature features are then mapped back to the image space, where they are combined with intensity features to train a finer cortical parcellation model. We also simplify the process of cortical surface reconstruction and curvature computation, thereby enhancing the overall efficiency of the framework. Additionally, our framework is flexible and can incorporate any neural network as its backbone. It can serve as a plug-and-play component to enhance the whole brain segmentation results of any segmentation network. Experimental results on the public Mindboggle-101 dataset demonstrate improved segmentation performance with comparable speed compared to various deep learning methods.

References

[1]
Chen H, Dou Q, Yu L, Qin J, and Heng PA Voxresnet: deep voxelwise residual networks for brain segmentation from 3D MR images Neuroimage 2018 170 446-455
[2]
Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, and Ronneberger O Ourselin S, Joskowicz L, Sabuncu MR, Unal G, and Wells W 3D U-net: learning dense volumetric segmentation from sparse annotation Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016 2016 Cham Springer 424-432
[3]
Coalson TS, Van Essen DC, and Glasser MF The impact of traditional neuroimaging methods on the spatial localization of cortical areas Proc. Nat. Acad. Sci. 2018 115 27 E6356-E6365
[4]
Desikan RS et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into GYRAL based regions of interest Neuroimage 2006 31 3 968-980
[5]
Fang L et al. Automatic brain labeling via multi-atlas guided fully convolutional networks Med. Image Anal. 2019 51 157-168
[6]
Fischl B Freesurfer Neuroimage 2012 62 2 774-781
[7]
Fischl B et al. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain Neuron 2002 33 3 341-355
[8]
Fischl B, Sereno MI, and Dale AM Cortical surface-based analysis: Ii: inflation, flattening, and a surface-based coordinate system Neuroimage 1999 9 2 195-207
[9]
Han X, Xu C, Braga-Neto U, and Prince JL Topology correction in brain cortex segmentation using a multiscale, graph-based algorithm IEEE Trans. Med. Imaging 2002 21 2 109-121
[10]
Hatamizadeh A, Nath V, Tang Y, Yang D, Roth HR, and Xu D Crimi A and Bakas S Swin UNETR: swin transformers for semantic segmentation of brain tumors in MRI images Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries - BrainLes 2021 2022 Cham Springer 272-284
[11]
Hatamizadeh, A., et al.: UNETR: transformers for 3D medical image segmentation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 574–584 (2022)
[12]
Huo Y et al. 3D whole brain segmentation using spatially localized atlas network tiles Neuroimage 2019 194 105-119
[13]
Isensee F, Jaeger PF, Kohl SA, Petersen J, and Maier-Hein KH NNU-net: a self-configuring method for deep learning-based biomedical image segmentation Nat. Methods 2021 18 2 203-211
[14]
Klein, A., Canton, T., Ghosh, S., Landman, B., Lee, J., Worth, A.: Open labels: online feedback for a public resource of manually labeled brain images. In: 16th Annual Meetings on Organization for Human Brain Mapping (2010)
[15]
Klein A and Tourville J 101 labeled brain images and a consistent human cortical labeling protocol Front. Neurosci. 2012 6 171
[16]
Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. In: Seminal Graphics: Pioneering Efforts That Shaped the Field, pp. 347–353 (1998)
[17]
Parvathaneni P, et al., et al. Shen D, et al., et al. Cortical surface parcellation using spherical convolutional neural networks Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 501-509
[18]
Pedregosa, F., et al.: Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12(Oct), 2825–2830 (2011)
[19]
Shattuck DW and Leahy RM Brainsuite: an automated cortical surface identification tool Med. Image Anal. 2002 6 2 129-142
[20]
Sun, L., et al.: Topological correction of infant white matter surfaces using anatomically constrained convolutional neural network. NeuroImage 198, 114–124 (2019)
[21]
Wang H, Suh JW, Das SR, Pluta JB, Craige C, and Yushkevich PA Multi-atlas segmentation with joint label fusion IEEE Trans. Pattern Anal. Mach. Intell. 2012 35 3 611-623
[22]
Wu Z et al. Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G, et al. Registration-free infant cortical surface parcellation using deep convolutional neural networks Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 2018 Cham Springer 672-680
[23]
Yeo BT, Sabuncu MR, Vercauteren T, Ayache N, Fischl B, and Golland P Spherical demons: fast diffeomorphic landmark-free surface registration IEEE Trans. Med. Imaging 2009 29 3 650-668
[24]
Yu X et al. Unest: local spatial representation learning with hierarchical transformer for efficient medical segmentation Med. Image Anal. 2023 90
[25]
Zhao, F., et al.: S3reg: superfast spherical surface registration based on deep learning. IEEE Trans. Med. Imaging (2021)
[26]
Zhao F, Wu Z, Wang L, Lin W, and Li G Wang L, Dou Q, Fletcher PT, Speidel S, and Li S Fast spherical mapping of cortical surface meshes using deep unsupervised learning Medical Image Computing and Computer Assisted Intervention - MICCAI 2022 2022 Cham Springer 163-173
[27]
Zhao F et al. Chung ACS, Gee JC, Yushkevich PA, Bao S, et al. Spherical U-net on cortical surfaces: methods and applications Information Processing in Medical Imaging 2019 Cham Springer 855-866

Index Terms

  1. A Curvature-Guided Coarse-to-Fine Framework for Enhanced Whole Brain Segmentation
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Guide Proceedings
    Medical Image Computing and Computer Assisted Intervention – MICCAI 2024: 27th International Conference, Marrakesh, Morocco, October 6–10, 2024, Proceedings, Part IX
    Oct 2024
    781 pages
    ISBN:978-3-031-72113-7
    DOI:10.1007/978-3-031-72114-4
    • Editors:
    • Marius George Linguraru,
    • Qi Dou,
    • Aasa Feragen,
    • Stamatia Giannarou,
    • Ben Glocker,
    • Karim Lekadir,
    • Julia A. Schnabel

    Publisher

    Springer-Verlag

    Berlin, Heidelberg

    Publication History

    Published: 07 October 2024

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Nov 2024

    Other Metrics

    Citations

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media