Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3590003.3590047acmotherconferencesArticle/Chapter ViewAbstractPublication PagescacmlConference Proceedingsconference-collections
research-article

MM-UNet: Multi-attention mechanism and multi-scale feature fusion UNet for tumor image segmentation

Published: 29 May 2023 Publication History

Abstract

To address the problems of many parameters and loss of spatial information in traditional Unet networks, this paper proposes a U-Net-based brain tumor segmentation model named MM-UNet to solve the problem of 3D image segmentation. Firstly, the U-Net model performs three times downsampling to extract the image features for the changing characteristics of brain tumor 3D images, which reduces the number of model parameters while maximally preserving the target edge features; then, a structure similar to FPN was used to achieve the fusion of multi-scale predictions; we introduce the channel attention mechanism and pixel attention mechanism to establish the relationship between global features; meanwhile, to improve the generalization ability of the model, data augmentation techniques are used to enhance the information. The experimental results show that the model proposed in this paper has improved the accuracy of brain tumor segmentation compared with U- Net, PSPNet, ICNet, and Fast- SCNN, suggesting 3.9%, 1.3%, 5%, and 3.9%, respectively.

References

[1]
LI Qiang, BAI Kexin, ZHAO Liu, Progresss and challenges of MRI brain tumor image segmentation [J].Journal of Chinese Image Graphics, 2020, 25 (3): 419-431 (in Chinese).
[2]
LeCun Y, Bengio Y, Hinton G. Deep learning[J]. nature, 2015, 521(7553): 436-444.
[3]
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]. International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015: 234-241.
[4]
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]. Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 3431-3440.
[5]
Badrinarayanan V, Kendall A, Cipolla R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(12): 2481-2495.
[6]
Pereira S, Pinto A, Amorim J, Adaptive feature recombination and recalibration for semantic segmentation with fully convolutional networks[J]. IEEE transactions on medical imaging, 2019, 38(12): 2914-2925.
[7]
Myronenko A. 3D MRI brain tumor segmentation using autoencoder regularization[C]. International MICCAI Brainlesion Workshop. Springer, Cham, 2018: 311-320.
[8]
SHELHAMER, EVAN, LONG, JONATHAN, DARRELL, TREVOR. Fully Convolutional Networks for Semantic Segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):640-651.
[9]
Milletari F, Navab N, Ahmadi SA. V-Net: Fully convolutional neural networks for volumetric medical image segmentation [C]//4th International Conference on 3D Vision.IEEE, 20 16:565-571.
[10]
Zhao H, Shi J, Qi X, Pyramid Scene Parsing Network[C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),2017.
[11]
Zhao H, Qi X, Shen X, ICNet for Real-Time Semantic Segmentation on High-Resolution Images[C]. Cham: Springer International Publishing, 2018: 418-434.
[12]
Poudel R P K, Liwicki S, Cipolla R. Fast-SCNN: Fast Semantic Segmentation Network[J]. Computer Science, 2019.

Cited By

View all
  • (2024)HRGUNet: A novel high-resolution generative adversarial network combined with an improved UNet method for brain tumor segmentationJournal of Visual Communication and Image Representation10.1016/j.jvcir.2024.104345105(104345)Online publication date: Dec-2024

Index Terms

  1. MM-UNet: Multi-attention mechanism and multi-scale feature fusion UNet for tumor image segmentation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CACML '23: Proceedings of the 2023 2nd Asia Conference on Algorithms, Computing and Machine Learning
    March 2023
    598 pages
    ISBN:9781450399449
    DOI:10.1145/3590003
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Attention mechanisms
    2. Brain tumor segmentation
    3. Deep learning
    4. Unet model

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    CACML 2023

    Acceptance Rates

    CACML '23 Paper Acceptance Rate 93 of 241 submissions, 39%;
    Overall Acceptance Rate 93 of 241 submissions, 39%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)49
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)HRGUNet: A novel high-resolution generative adversarial network combined with an improved UNet method for brain tumor segmentationJournal of Visual Communication and Image Representation10.1016/j.jvcir.2024.104345105(104345)Online publication date: Dec-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media