Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

Severity wise COVID-19 X-ray image augmentation and classification using structure similarity

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Deep Learning models are widely used to address COVID-19 challenges, but they require a large number of training samples. X-ray images of COVID-19 patients are amongst the preferred methods for detection. However, their availability is limited. In contrast, X-ray images of non-COVID-19 patients are available in abundance. Furthermore, COVID-19 patient's treatment varies based on infection severity. This leads to a class imbalance issue as there are far more X-ray images of non-COVID patients than COVID-19 patients available for training deep learning models. As a result, deep learning models cannot achieve the desired levels of accuracy. This study's primary objective is to generate synthetic X-ray images depicting three levels of severity, utilizing a Cycle Consistent Generative Adversarial Network (CycleGAN). The Structural Similarity Index (SSIM) is employed to create training datasets for three severity levels, which are then used to train the corresponding CycleGAN models. Additionally, a comparative analysis is conducted to compare the achieved accuracies between X-ray images of COVID-19 patients and non-COVID-19 patients. This analysis involves datasets containing authentic non-synthetic COVID-19 X-ray images and datasets containing synthetic COVID-19 X-ray images generated using CycleGAN. The results indicate enhanced accuracy when deep models are trained using augmented X-ray data. This study is novel as no prior work has been done on severity-wise dataset generation and classification of COVID-19 X-ray images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. NIPS 27

  2. Fujioka T, Mori M, Kubota K, Kikuchi Y, Katsuta L, Adachi M, Oda G, Nakagawa T, Kitazume Y, Tateishi U (2019) Breast ultrasound image synthesis using deep convolutional generative adversarial networks. Diagnostics 9

  3. Odena A, Olah C, Shlens J (2016) Conditional image synthesis with auxiliary classifier gans. In: International Conference on Machine Learning

  4. Wua X, Xu K, Hall P (2019) A survey of image synthesis and editing with generative adversarial networks. Tsinghua Sci Technol 22(6):660–674

    Article  Google Scholar 

  5. Hiasa Y, Otake Y, Takao M, Matsuoka T, Takashima K, Prince JL, Sugano N, Sato Y (2018) Cross-modality image synthesis from unpaired data using cyclegan: Effects of gradient consistency loss and training data size. ArXiv abs/1803.06629

  6. Hiasa Y, Otake Y, Takao M, Matsuoka T, Takashima K, Carass A, Prince JL, Sugano N, Sato Y (2018) Cross-modality image synthesis from unpaired data using cyclegan. Simulation and Synthesis in Medical Imaging

  7. Lei Y, Qiu RL, Wang T, Curran WJ, Liu T, Yang X (2020) Generative adversarial network for image synthesis. arXiv:2012.15446

  8. Kesim E, Dokur Z, Olmez T (2019) X-ray chest image classification by a small-sized convolutional neural network. 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), pp 1–5

  9. Liu C, Cao Y, Alcantara M, Liu B, Brunette M, Peinado J, Curioso W (2017) Tx-cnn: Detecting tuberculosis in chest x-ray images using convolutional neural network. In: 2017 IEEE international conference on image processing (ICIP), pp 2314–2318. https://doi.org/10.1109/ICIP.2017.8296695

  10. Dong Y, Pan Y, Zhang J, Xu W (2017) Learning to read chest x-ray images from 16000+ examples using cnn. In: 2017 IEEE/ACM Interna- tional Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), pp 51–57. https://doi.org/10.1109/CHASE.2017.59

  11. Xu S, Wu H, Bie R (2019) Cxnet-m1: anomaly detection on chest x-rays with image-based deep learning. IEEE Access 7:4466–4477. https://doi.org/10.1109/ACCESS.2018.2885997

    Article  Google Scholar 

  12. Chouhan V, Singh SK, Khamparia A, Gupta D, Tiwari P, Moreira C, Damaševičius R, de Albuquerque VHC (2020) A novel transfer learning based approach for pneumonia detection in chest x-ray images. Appl Sci 10(2)

  13. Rajpurkar P, Irvin J, Ball RL, Zhu K, Yang B, Mehta H, Duan T, Ding D, Bagul A, Langlotz CP, Patel BN, Yeom KW, Shpanskaya K, Blankenberg FG, Seekins J, Amrhein TJ, Mong DA, Halabi SS, Zucker EJ, Ng AY, Lungren MP (2018) Deep learning for chest radiograph diagnosis: a retrospective comparison of the chexnext algorithm to practicing radiologists. arXiv:2012.15446

  14. Li X, Shen L, Xie X, Huang S, Xie Z, Hong X, Yu J (2020) Multi-resolution convolutional networks for chest x-ray radiograph based lung nodule detection. Artif Intell Med 103

  15. Bhandary A, Prabhu GA, Rajinikanth V, Thanaraj KP, Satapathy SC, Robbins DE, Shasky C, Zhang Y-D, Tavares JMRS, Raja NSM (2020) Deep-learning framework to detect lung abnormality - a study with chest x-ray and lung ct scan images. Pattern Recogn Lett 129:271–278

    Article  ADS  Google Scholar 

  16. Min Y, Hu L, Wei L, Nie S (2022) Computer-aided detection of pulmonary nodules based on convolutional neural networks: a review. Phys Med Biol

  17. Zunair H, Hamza AB (2021) Synthetic covid-19 chest x-ray dataset for computer-aided diagnosis. arXiv:2106.09759

  18. Karbhari Y, Basu A, Geem ZW, Han G-T, Sarkar R (2021) Generation of synthetic chest x-ray images and detection of covid-19: a deep learning based approach. Diagnostics 11

  19. Taylor E, Haven K, Reed P, Bissielo A, Harvey D, McArthur C, Bringans C, Freundlich S, Ingram RJH, Perry D, Wilson F, Milne D, Modahl L, Huang QS, Gross D, Widdowson M-A, Grant CC, S. I. Team (2015) A chest radiograph scoring system in patients with severe acute respiratory infection: a validation study. BMC Med Imaging

  20. Yoon SH, Lee KH, Kim JY, Lee YK, Ko H, Kim KH, Park CM, Kim YH (2020) Chest radiographic and ct findings of the 2019 novel coronavirus disease (covid-19): analysis of nine patients treated in Korea. Korean J Radiol 21(4):498–504

  21. Wong HYF, Lam HYS, Fong AH-T, Leung ST, Chin TW-Y, Lo CSY, Lui MM-S, Lee JCY, Chiu KW-H, Chung TW-H, Lee EYP, Wan EYF, Hung IFN, Lam TPW, Kuo MD, Ng M-Y (2020) Frequency and distribution of chest radiographic findings in patients positive for covid-19. Radiology 296(2)

  22. Warren MA, Zhao Z, Koyama T, Bastarache JA, Shaver CM, Semler MW, Rice TW, Matthay MA, Calfee CS, Ware LB (2018) Severity scoring of lung oedema on the chest radiograph is associated with clinical outcomes in ards. Thorax 73:840–846

    Article  PubMed  Google Scholar 

  23. Yang R, Li X, Liu H, Zhen Y, Zhang X, Xiong Q, Luo Y, Gao C, Zeng W (2020) Chest ct severity score: An imaging tool for assessing severe covid-19. Radiol Cardiothorac Imaging 2(2)

  24. Chang Y-C, Yu C-J, Chang S-C, Galvin JR, Liu H-M, Hsiao C-H, Kuo P-H, Chen K-Y, Franks TJ, Huang K-M, Yang P-C (2005) Pulmonary sequelae in convalescent patients after severe acute respiratory syndrome: evaluation with thin-section CT. Radiology 236(3)

  25. Li K, Wu J, Wu F, Guo D, Chen L, Fang Z, Li C (2020) The clinical and chest ct features associated with severe and critical covid-19 pneumonia. Investig Radiol

  26. Chowdhury M, Rahman T, Khandakar A, Mazhar R, Kadir M, Mahbub Z, Islam K, Khan MS, Iqbal A, Al-Emadi N, Reaz MBI, Islam M (2020) Can ai help in screening viral and covid-19 pneumo- nia? IEEE Access 8:132665–132676

    Article  Google Scholar 

  27. Rahman T, Khandakar A, Qiblawey Y, Tahir A, Kiranyaz S, Abul Kashem SB, Islam MT, Al Maadeed S, Zughaier SM, Khan MS, Chowdhury MEH (2021) Exploring the effect of image enhancement techniques on covid-19 detection using chest x-ray images. Comput Biol Med 132:104319

  28. Motamed S, Rogalla P, Khalvati F (2021) Data augmentation using generative adversarial networks (gans) for gan-based detection of pneumonia and covid-19 in chest x-ray images. Informatics in Medicine Unlocked. Elsevier 27:100779

  29. Bargshady G, Zhou X, Barua PD, Gururajan R, Li Y, Acharya UR (2022) Application of cyclegan and transfer learning techniques for automated detection of covid-19 using x-ray images. Pattern Recognit Lett. Elsevier 27:67–74

  30. Gupta V, Jain N, Sachdeva J, Gupta M, kumar Mohan S, Bajuri MY, Ahmadian A (2022) Improved covid-19 detection with chest x-ray images using deep learning. Multimed Tools Appl 37657–37680

  31. Bhosale YH, Patnaik KS (2023) Bio-medical imaging (x-ray, ct, ultrasound, ecg), genome sequences applications of deep neural network and machine learning in diagnosis, detection, classification, and segmentation of covid-19: a meta-analysis systematic review. Multimed Tools Appl

  32. Jangam E, Annavarapu CSR, Barreto AAD (2023) A multi-class classification framework for disease screening and disease diagnosis of covid-19 from chest x-ray images. Multimed Tools Appl 14367–14401

  33. Singh AK, Kumar A, Kumar V, Prakash S (2023) Covid-19 detection using adopted convolutional neural networks and high-performance computing. Multimed Tools Appl

Download references

Acknowledgements

This work is supported by the "Research and Development Scheme of DST" under the project grant no "DST/ICD/Serbia/P-03/2021/(G)"

Author information

Authors and Affiliations

  1. Indian Institute of Information Technology Lucknow, Lucknow, India

    Pulkit Dwivedi, Sandeep Padhi & Soumendu Chakraborty

  2. Thapar University, Patiala, India

    Suresh Chandra Raikwar

Authors
  1. Pulkit Dwivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sandeep Padhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Soumendu Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Suresh Chandra Raikwar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pulkit Dwivedi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dwivedi, P., Padhi, S., Chakraborty, S. et al. Severity wise COVID-19 X-ray image augmentation and classification using structure similarity. Multimed Tools Appl 83, 30719–30740 (2024). https://doi.org/10.1007/s11042-023-16555-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16555-8

Keywords

Search

Navigation