Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3364836.3364862acmotherconferencesArticle/Chapter ViewAbstractPublication PagesisicdmConference Proceedingsconference-collections
research-article

Cardiac Motion Scoring Based on CNN with Attention Mechanism

Published: 24 August 2019 Publication History

Abstract

Motion scoring of cardiac myocardium is essential for early detection and diagnosis of various cardiac diseases. Existing work on the myocardium motion mainly focuses on binary abnormality detection, while the myocardium motion can be clinically classified into four types: normal, hypokinetic, akinetic and dyskinetic, which has greater significance and is more challenging to predict. The state-of-the-art demonstrated that the method for cardiac motion scoring from MR sequences based on deep convolution neural network (CNN) with non-local attention has great potential. However, due to the complex myocardium deformation and subtle inter-class difference of motion patterns, the performance is still not satisfactory. In this paper, we introduce two types of "attention mechanism" to enhance the ability of the CNN network by effectively extracting the dependency in time-wise, space-wise and cardiac segment-wise. Experiment on 1440 myocardium segments of 90 subjects from short-axis MR sequences of multiple lengths prove that our method's prediction is more precise and consistent which paves the way to the potential implementation in clinical routine.

References

[1]
Lang, R. M., Badano, L. P., Mor-Avi, V., Afilalo, J., Armstrong, A., & Ernande, L., et al. (2015). Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the american society of echocardiography and the european association of cardiovascular imaging. European Heart Journal - Cardiovascular Imaging, 16(3), 233--271.
[2]
Paetsch, I., Jahnke, C., Ferrari, V. A., Rademakers, F. E., Pellikka, P. A., & Hundley, W. G., et al. (2006). Determination of interobserver variability for identifying inducible left ventricular wall motion abnormalities during dobutamine stress magnetic resonance imaging. European Heart Journal, 27(12), 1459.
[3]
Afshin, M., Ben Ayed, I., Punithakumar, K., Law, M., Islam, A., & Goela, A., et al. (2014). Regional assessment of cardiac left ventricular myocardial function via mri statistical features. IEEE Transactions on Medical Imaging, 33(2), 481--494.
[4]
Leung, K. Y. E., & Bosch, J. G. (2007). Localized shape variations for classifying wall motion in echocardiograms. Medical Image Computing and Computer-Assist Intervention-MICCAI 2007, 10(1), 52--59.
[5]
Mantilla, J., José Paredes, Bellanger, J. J., Donal, E., Leclercq, C., & Rubén Medina, et al. (2015). Classification of LV wall motion in cardiac MRI using kernel Dictionary Learning with a parametric approach. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE.
[6]
Punithakumar, K., Ben Ayed, I., Islam, A., Ross, I. G., & Li, S. (2010). Regional heart motion abnormality detection via information measures and unscented Kalman filtering. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2010. Springer Berlin Heidelberg.
[7]
Xue, W., Brahm, G., Leung, S., Shmuilovich, O., & Li, S. (2018). Cardiac motion scoring with segment- and subject-level non-local modeling. Medical Image Computing and Computer-Assist Intervention-MICCAI 2018.
[8]
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., & Gomez, A. N., et al. (2017). Attention is All you Need. Advances in Neural Information Processing Systems 30.
[9]
You, Q., Jin, H., Wang, Z., Fang, C., & Luo, J. (2016). Image Captioning with Semantic Attention. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[10]
Li, X., Wang, W., Hu, X., & Yang, J. (2019). Selective kernel networks. arXiv: 1903.06586v2 [cs.CV]
[11]
Hu, J., Shen, L., & Sun, G. (2017). Squeeze-and-excitation networks. IEEE Transactions on Pattern Analysis and Machine Intelligence.
[12]
Wang, X., Girshick, R., Gupta, A., & He, K. (2018). Non-local neural networks. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Cited By

View all
  • (2024)Multiscale Feature Attention Module Based Pyramid Network for Medical Digital Radiography Image EnhancementIEEE Access10.1109/ACCESS.2024.338741312(53686-53697)Online publication date: 2024
  • (2022)A New X-ray Medical-Image-Enhancement Method Based on Multiscale Shannon–Cosine WaveletEntropy10.3390/e2412175424:12(1754)Online publication date: 30-Nov-2022
  • (2022)DMA‐Net: Dual multi‐instance attention network for X‐ray image classificationIET Image Processing10.1049/ipr2.1256016:13(3518-3528)Online publication date: 8-Jul-2022
  • Show More Cited By

Index Terms

  1. Cardiac Motion Scoring Based on CNN with Attention Mechanism

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ISICDM 2019: Proceedings of the Third International Symposium on Image Computing and Digital Medicine
    August 2019
    370 pages
    ISBN:9781450372626
    DOI:10.1145/3364836
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Xidian University

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 August 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Cardiac motion scoring
    2. attention mechanism
    3. deep learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ISICDM 2019

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Multiscale Feature Attention Module Based Pyramid Network for Medical Digital Radiography Image EnhancementIEEE Access10.1109/ACCESS.2024.338741312(53686-53697)Online publication date: 2024
    • (2022)A New X-ray Medical-Image-Enhancement Method Based on Multiscale Shannon–Cosine WaveletEntropy10.3390/e2412175424:12(1754)Online publication date: 30-Nov-2022
    • (2022)DMA‐Net: Dual multi‐instance attention network for X‐ray image classificationIET Image Processing10.1049/ipr2.1256016:13(3518-3528)Online publication date: 8-Jul-2022
    • (2022)Adaptive aggregation with self‐attention network for gastrointestinal image classificationIET Image Processing10.1049/ipr2.12495Online publication date: 10-Apr-2022
    • (2021)Attention-Based Gated Recurrent Unit for Gesture RecognitionIEEE Transactions on Automation Science and Engineering10.1109/TASE.2020.303085218:2(495-507)Online publication date: Apr-2021
    • (2020)Pyramid attention recurrent networks for real-time guidewire segmentation and tracking in intraoperative X-ray fluoroscopyComputerized Medical Imaging and Graphics10.1016/j.compmedimag.2020.10173483(101734)Online publication date: Jul-2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media