Abstract
Glaucoma is one of the leading causes of blindness in humans, which is not reversible, but early detection and treatment can save helpful vision. Clinicians classify glaucoma into early, moderate, and advanced stages based on the extent of the patient’s visual field deficit. The treatment of glaucoma varies with the course of the disease. With the development of deep learning technology, more and more studies focus on the automatic diagnosis of glaucoma. Most of them are based on color fundus images or OCT images. However, there are limitations in using only one modality images to analyze glaucoma due to the complexity of glaucoma. Therefore, in this paper, two modalities of images, color fundus image and 3D OCT image provided by the GAMMA Challenge, were used to design baseline algorithms for glaucoma grading. On the preliminary dataset of the GAMMA Challenge, the kappa value of the glaucoma grading results based on the two modalities of image input were improved by 0.092 and 0.075, respectively, compared with those of the model with single fundus image and single OCT image input. And on the final datasets, the corresponding improvement were 0.029 and 0.127. At the same time, considering that optic disc changes are the main features of glaucoma, we added local information of optic disc into the input module, so that the kappa values were improved respectively by 0.075 and 0.068 in the preliminary dataset and final dataset of the model based on the images of two modalities as input. In addition, this study used an ordinal regression strategy on the classification task to increase the kappa value of the results of automatic classification of glaucoma based on multi-modality images by 0.097 and 0.050 on the preliminary and final datasets of the GAMMA Challenge.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ahn, J.M., Kim, S., Ahn, K.S., Cho, S.H., Lee, K.B., Kim, U.S.: A deep learning model for the detection of both advanced and early glaucoma using fundus photography. PLoS One 13(11), e0207982 (2018)
An, G., et al.: Glaucoma diagnosis with machine learning based on optical coherence tomography and color fundus images. J. Healthcare Eng. 2019 (2019)
Fu, H., Cheng, J., Xu, Y., Wong, D.W.K., Liu, J., Cao, X.: Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE Trans. Med. Imag. 37(7), 1597–1605 (2018)
Gómez-Valverde, J.J., et al.: Automatic glaucoma classification using color fundus images based on convolutional neural networks and transfer learning. Biomed. Optics Express 10(2), 892–913 (2019)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Hodapp, E., Parrish, R.K., Anderson, D.R.: Clinical Decisions in Glaucoma. Mosby Incorporated, Chicago (1993)
Niu, Z., Zhou, M., Wang, L., Gao, X., Hua, G.: Ordinal regression with multiple output CNN for age estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4920–4928 (2016)
Orlando, J.I., et al.: Refuge challenge: a unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med. Image Anal. 59, 101570 (2020)
Phene, S., et al.: Deep learning and glaucoma specialists: the relative importance of optic disc features to predict glaucoma referral in fundus photographs. Ophthalmology 126(12), 1627–1639 (2019)
Ronneberger, Olaf, Fischer, Philipp, Brox, Thomas: U-Net: convolutional networks for biomedical image segmentation. In: Navab, Nassir, Hornegger, Joachim, Wells, William M.., Frangi, Alejandro F.. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Tham, Y.C., Li, X., Wong, T.Y., Quigley, H.A., Aung, T., Cheng, C.Y.: Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. Ophthalmology 121(11), 2081–2090 (2014)
Xiulan, Z., Yanwu, X., Weihua, Y.: Annotation and quality control specifications for fundus color photograph. Intelligent Medicine (2021)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Fang, H., Shang, F., Fu, H., Li, F., Zhang, X., Xu, Y. (2021). Multi-modality Images Analysis: A Baseline for Glaucoma Grading via Deep Learning. In: Fu, H., Garvin, M.K., MacGillivray, T., Xu, Y., Zheng, Y. (eds) Ophthalmic Medical Image Analysis. OMIA 2021. Lecture Notes in Computer Science(), vol 12970. Springer, Cham. https://doi.org/10.1007/978-3-030-87000-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-87000-3_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86999-1
Online ISBN: 978-3-030-87000-3
eBook Packages: Computer ScienceComputer Science (R0)