research-article

EXAM: An Explainable Attention-based Model for COVID-19 Automatic Diagnosis

Authors:

May D. WangAuthors Info & Claims

BCB '20: Proceedings of the 11th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics

Article No.: 36, Pages 1 - 6

https://doi.org/10.1145/3388440.3412455

Published: 10 November 2020 Publication History

Abstract

The ongoing coronavirus disease 2019 (COVID-19) is still rapidly spreading and has caused over 7,000,000 infection cases and 400,000 deaths around the world. To come up with a fast and reliable COVID-19 diagnosis system, people seek help from machine learning area to establish computer-aided diagnosis systems with the aid of the radiological imaging techniques, like X-ray imaging and computed tomography imaging. Although artificial intelligence based architectures have achieved great improvements in performance, most of the models are still seemed as a black box to researchers. In this paper, we propose an Explainable Attention-based Model (EXAM) for COVID-19 automatic diagnosis with convincing visual interpretation. We transform the diagnosis process with radiological images into an image classification problem differentiating COVID-19, normal and community-acquired pneumonia (CAP) cases. Combining channel-wise and spatial-wise attention mechanism, the proposed approach can effectively extract key features and suppress irrelevant information. Experiment results and visualization indicate that EXAM outperforms recent state-of-art models and demonstrate its interpretability.

References

[1]

2020. Automated detection of COVID-19 cases using deep neural networks with X-ray images. Computers in Biology and Medicine 121 (2020), 103792.

[2]

Aditya Chattopadhay, Anirban Sarkar, Prantik Howlader, and Vineeth N Balasubramanian. 2018. Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 839--847.

[3]

Anirudh Choudhary, Li Tong, Yuanda Zhu, and May D Wang. 2020. Advancing Medical Imaging Informatics by Deep Learning-Based Domain Adaptation. In Yearbook of Medical Informatics. In Press.

[4]

Joseph Paul Cohen, Paul Morrison, Lan Dao, Karsten Roth, Tim Q Duong, and Marzyeh Ghassemi. 2020. COVID-19 Image Data Collection: Prospective Predictions Are the Future. arXiv preprint arXiv.2006.11988 (2020).

[5]

Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. 2017. Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision. 764--773.

[6]

Xiaoqing Guo and Yixuan Yuan. 2019. Triple ANet: Adaptive abnormal-aware attention network for WCE image classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention. 293--301.

Digital Library

[7]

Craig Hacking Henry Knipe. 2020. Radiopaedia Pneumonia dataset. Website. https://radiopaedia.org/articles/pneumonia.

[8]

Jie Hu, Li Shen, and Gang Sun. 2018. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7132--7141.

[9]

Md. Rezaul Karim, Till Döhmen, Dietrich Rebholz-Schuhmann, Stefan Decker, Michael Cochez, and Oya Deniz Beyan. 2020. DeepCOVIDExplainer: Explainable COVID-19 Predictions Based on Chest X-ray Images. ArXiv abs/2004.04582 (2020).

[10]

Italian Society of Medical and Interventional Radiology (SIRM). 2020. COVID-19 DATABASE. https://www.sirm.org/category/senza-categoria/covid-19/

[11]

Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why should i trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 1135--1144.

Digital Library

[12]

Ying Sha and May D Wang. 2017. Interpretable predictions of clinical outcomes with an attention-based recurrent neural network. In Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. 233--240.

Digital Library

[13]

Yi Sun, Yuheng Chen, Xiaogang Wang, and Xiaoou Tang. 2014. Deep learning face representation by joint identification-verification. In Advances in neural information processing systems. 1988--1996.

[14]

Janani Venugopalan, Hamid Hassanzadeh, Li Tong, and May D Wang. 2020. Multimodal Deep Learning Models for Early Detection of Alzheimer's Disease Stage. In Nature Scientific Reports. In Press.

[15]

Linda Wang and Alexander Wong. 2020. COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. arXiv (2020), arXiv-2003.

[16]

Shuai Wang, Bo Kang, Jinlu Ma, Xianjun Zeng, Mingming Xiao, Jia Guo, Mengjiao Cai, Jingyi Yang, Yaodong Li, Xiangfei Meng, et al. 2020. Adeep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19). MedRxiv (2020).

[17]

Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. Non-local neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7794--7803.

[18]

Xiaosong Wang, Yifan Peng, Le Lu, Zhiyong Lu, Mohammadhadi Bagheri, and Ronald M Summers. 2017. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2097--2106.

[19]

Sanghyun Woo, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. Cbam: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision (ECCV). 3--19.

Digital Library

[20]

X Xu, X Jiang, C Ma, P Du, X Li, S Lv, L Yu, Y Chen, J Su, G Lang, et al. [n.d.]. Deep learning system to screen coronavirus disease 2019 pneumonia. arXiv 2020. arXiv preprint arXiv:2002.09334 ([n. d.]).

[21]

Chaochao Yan, Jiawen Yao, Ruoyu Li, Zheng Xu, and Junzhou Huang. 2018. Weakly supervised deep learning for thoracic disease classification and localization on chest x-rays. In Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. 103--110.

Digital Library

[22]

Muhammad Rehman Zafar and Naimul Mefraz Khan. 2019. DLIME: a deterministic local interpretable model-agnostic explanations approach for computer-aided diagnosis systems. arXiv preprint arXiv:1906.10263 (2019).

[23]

Yundong Zhang, Hang Wu, Huiye Liu, Li Tong, and May D Wang. 2019. Mitigating the effect of dataset bias on training deep models for chest X-rays. arXiv preprint arXiv.1910.06745 (2019).

[24]

Jinyu Zhao, YichenZhang, Xuehai He, and Pengtao Xie. 2020. COVID-CT-Dataset: a CT scan dataset about COVID-19. arXiv preprint arXiv:2003.13865 (2020).

[25]

Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. 2016. Learning deep features for discriminative localization. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2921--2929.

Cited By

Brima YAtemkeng M(2024)Saliency-driven explainable deep learning in medical imaging: bridging visual explainability and statistical quantitative analysisBioData Mining10.1186/s13040-024-00370-417:1Online publication date: 22-Jun-2024
https://doi.org/10.1186/s13040-024-00370-4
Muhammad DBendechache M(2024)Unveiling the Black Box: A Systematic Review of Explainable Artificial Intelligence in Medical Image AnalysisComputational and Structural Biotechnology Journal10.1016/j.csbj.2024.08.005Online publication date: Aug-2024
https://doi.org/10.1016/j.csbj.2024.08.005
Ben Tamo JShi WZhu YNnamdi MIwinski HWattenbarger MWang MWang MYoon B(2023)Adolescent Idiopathic Scoliosis Patient Subphenotyping for Surgical Planning and Improved Patient OutcomesProceedings of the 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics10.1145/3584371.3612957(1-10)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3584371.3612957
Show More Cited By

Index Terms

EXAM: An Explainable Attention-based Model for COVID-19 Automatic Diagnosis
1. Applied computing
  1. Life and medical sciences
    1. Computational biology
      1. Imaging
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Post-pandemic healthcare for COVID-19 vaccine: Tissue-aware diagnosis of cervical lymphadenopathy via multi-modal ultrasound semantic segmentation
Abstract
With the widespread deployment of COVID-19 vaccines all around the world, billions of people have benefited from the vaccination and thereby avoiding infection. However, huge amount of clinical cases revealed diverse side effects of ...
Highlights
- We design a framework for rapid cervical LN diagnosis of COVID-19 vaccine recipients.
Application of Machine Learning and Deep Learning Techniques for COVID-19 Screening Using Radiological Imaging: A Comprehensive Review
Abstract
Lung, being one of the most important organs in human body, is often affected by various SARS diseases, among which COVID-19 has been found to be the most fatal disease in recent times. In fact, SARS-COVID 19 led to pandemic that spreads fast ...
FAM: focal attention module for lesion segmentation of COVID-19 CT images
Abstract
The novel coronavirus pneumonia (COVID-19) is the world’s most serious public health crisis, posing a serious threat to public health. In clinical practice, automatic segmentation of the lesion from computed tomography (CT) images using deep ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

BCB '20: Proceedings of the 11th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics

September 2020

193 pages

ISBN:9781450379649

DOI:10.1145/3388440

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGBio: ACM Special Interest Group on Bioinformatics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Petit Institute Faculty Fellow
Carol Ann and David Flanagan Faculty Fellow
Amazon Research Fauclty Fellow
Microsoft Azure Cloud

Conference

BCB '20

Sponsor:

SIGBio

BCB '20: 11th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics

September 21 - 24, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 254 of 885 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
237
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)5

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Brima YAtemkeng M(2024)Saliency-driven explainable deep learning in medical imaging: bridging visual explainability and statistical quantitative analysisBioData Mining10.1186/s13040-024-00370-417:1Online publication date: 22-Jun-2024
https://doi.org/10.1186/s13040-024-00370-4
Muhammad DBendechache M(2024)Unveiling the Black Box: A Systematic Review of Explainable Artificial Intelligence in Medical Image AnalysisComputational and Structural Biotechnology Journal10.1016/j.csbj.2024.08.005Online publication date: Aug-2024
https://doi.org/10.1016/j.csbj.2024.08.005
Ben Tamo JShi WZhu YNnamdi MIwinski HWattenbarger MWang MWang MYoon B(2023)Adolescent Idiopathic Scoliosis Patient Subphenotyping for Surgical Planning and Improved Patient OutcomesProceedings of the 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics10.1145/3584371.3612957(1-10)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3584371.3612957
Giuste FShi WZhu YNaren TIsgut MSha YTong LGupte MWang M(2023)Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic ReviewIEEE Reviews in Biomedical Engineering10.1109/RBME.2022.318595316(5-21)Online publication date: 2023
https://doi.org/10.1109/RBME.2022.3185953
Shi WMurakoso MGuo XXiong LChen MWang M(2023)Effective Surrogate Models for Docking Scores Prediction of Candidate Drug Molecules on SARS-CoV-2 Protein Targets2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)10.1109/BIBM58861.2023.10385643(4235-4242)Online publication date: 5-Dec-2023
https://doi.org/10.1109/BIBM58861.2023.10385643
Chandra SBajpai M(2023)Efficient Machine Learning and Factional Calculus Based Mathematical Model for Early COVID PredictionHuman-Centric Intelligent Systems10.1007/s44230-023-00042-23:4(508-520)Online publication date: 31-Aug-2023
https://doi.org/10.1007/s44230-023-00042-2
Zhu YMahale APeters KMathew LGiuste FAnderson BWang M(2022)Using natural language processing on free-text clinical notes to identify patients with long-term COVID effectsProceedings of the 13th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics10.1145/3535508.3545555(1-9)Online publication date: 7-Aug-2022
https://dl.acm.org/doi/10.1145/3535508.3545555
Lee BMartirosyan SKhan ZChiu HWang ZShi WGiuste FZhong YSun JWang M(2022)Attention-based Automated Chest CT Image Segmentation Method of COVID-19 Lung Infection2022 IEEE 22nd International Conference on Bioinformatics and Bioengineering (BIBE)10.1109/BIBE55377.2022.00042(158-163)Online publication date: Nov-2022
https://doi.org/10.1109/BIBE55377.2022.00042
Li YHsu JBari NQiu XViswanathan MShi WGiuste FZhong YSun JWang M(2022)Interpretable Evaluation of Diabetic Retinopathy Grade Regarding Eye Color Fundus Images2022 IEEE 22nd International Conference on Bioinformatics and Bioengineering (BIBE)10.1109/BIBE55377.2022.00011(11-16)Online publication date: Nov-2022
https://doi.org/10.1109/BIBE55377.2022.00011
Mahale AZhu YBelhareth SGraf AKruger KKrzak JWang M(2022)Automating Treatment Recommendations for Children with Cerebral Palsy Based on Multi-Modal Clinical Data2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI)10.1109/BHI56158.2022.9926836(1-4)Online publication date: 27-Sep-2022
https://doi.org/10.1109/BHI56158.2022.9926836
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents