Abstract
The performance of predicting biological markers from brain scans has rapidly increased over the past years due to the availability of open datasets and efficient deep learning algorithms. There are two concerns with these algorithms, however: they are black-box models, and they can suffer from over-fitting to the training data due to their high capacity. Explainability for visualizing relevant structures aims to address the first issue, whereas data augmentation and pre-processing are used to avoid overfitting and increase generalization performance. In this context, critical open issues are: (i) how robust explainability is across training setups, (ii) how a higher model performance relates to explainability, and (iii) what effects pre-processing and augmentation have on performance and explainability. Here, we use a dataset of 1,452 scans to investigate the effects of augmentation and pre-processing via brain registration on explainability for the task of brain age estimation. Our multi-seed analysis shows that although both augmentation and registration significantly boost loss performance, highlighted brain structures change substantially across training conditions. Our study highlights the need for a careful consideration of training setups in interpreting deep learning outputs in brain analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abraham, A., et al.: Machine learning for neuroimaging with scikit-learn. Front. Neuroinform. 14 (2014)
Aycheh, H.M., et al.: Biological brain age prediction using cortical thickness data: a large scale cohort study. Front. Aging Neurosci. 10, 252 (2018)
Cole, J.H., et al.: Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker. Neuroimage 163, 115–124 (2017)
Dafflon, J., et al.: An automated machine learning approach to predict brain age from cortical anatomical measures. Hum. Brain Mapp. 41(13), 3555–3566 (2020)
Dinsdale, N.K., et al.: Learning patterns of the ageing brain in MRI using deep convolutional networks. Neuroimage 224, 117401 (2021)
Fama, R., Sullivan, E.V.: Thalamic structures and associated cognitive functions: relations with age and aging. Neurosci. Biobehav. Rev. 54, 29–37 (2015)
Garyfallidis, E., et al.: DIPY, a library for the analysis of diffusion MRI data. Front. Neuroinform. 8, 8 (2014)
Greve, D.N., Fischl, B.: Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48(1), 63–72 (2009)
Gupta, U., Lam, P.K., Ver Steeg, G., Thompson, P.M.: Improved brain age estimation with slice-based set networks. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 840–844. IEEE (2021)
Hara, K., Kataoka, H., Satoh, Y.: Can spatiotemporal 3D CNNs retrace the history of 2D CNNs and ImageNet? In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6546–6555 (2018)
Heckemann, R.A., et al.: Information extraction from medical images: developing an e-science application based on the Globus toolkit. In: Proceedings of 2nd UK E-Science Hands Meet (2003)
Hepp, T., et al.: Uncertainty estimation and explainability in deep learning-based age estimation of the human brain: results from the German national cohort MRI study. Comput. Med. Imaging Graph. 92, 101967 (2021)
Huang, T.W., et al.: Age estimation from brain MRI images using deep learning. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 849–852. IEEE (2017)
Hughes, E.J., et al.: Regional changes in thalamic shape and volume with increasing age. Neuroimage 63(3), 1134–1142 (2012)
Kaye, J.A., DeCarli, C., Luxenberg, J.S., Rapoport, S.I.: The significance of age-related enlargement of the cerebral ventricles in healthy men and women measured by quantitative computed x-ray tomography. J. Am. Geriatr. Soc. 40(3), 225–231 (1992)
Kwon, Y.H., Jang, S.H., Yeo, S.S.: Age-related changes of lateral ventricular width and periventricular white matter in the human brain: a diffusion tensor imaging study. Neural Regen. Res. 9(9), 986 (2014)
LaMontagne, P.J., et al.: Oasis-3: longitudinal neuroimaging, clinical, and cognitive dataset for normal aging and Alzheimer disease. medRxiv (2019)
Levakov, G., Rosenthal, G., Shelef, I., Raviv, T.R., Avidan, G.: From a deep learning model back to the brain-identifying regional predictors and their relation to aging. Hum. Brain Mapp. 41(12), 3235–3252 (2020)
Lipton, Z.C.: The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue 16(3), 31–57 (2018)
Lockhart, S.N., DeCarli, C.: Structural imaging measures of brain aging. Neuropsychol. Rev. 24(3), 271–289 (2014)
Luft, A.R., et al.: Patterns of age-related shrinkage in cerebellum and brainstem observed in vivo using three-dimensional MRI Volumetry. Cereb. Cortex 9(7), 712–721 (1999)
Marcus, D.S., Wang, T.H., Parker, J., Csernansky, J.G., Morris, J.C., Buckner, R.L.: Open access series of imaging studies (OASIS): cross-sectional mri data in young, middle aged, nondemented, and demented older adults. J. Cogn. Neurosci. 19(9), 1498–1507 (2007)
Niu, X., Zhang, F., Kounios, J., Liang, H.: Improved prediction of brain age using multimodal neuroimaging data. Hum. Brain Mapp. 41(6), 1626–1643 (2020)
Park, J., et al.: Neural broadening or neural attenuation? Investigating age-related dedifferentiation in the face network in a large lifespan sample. J. Neurosci. 32(6), 2154–2158 (2012)
Peng, H., Gong, W., Beckmann, C.F., Vedaldi, A., Smith, S.M.: Accurate brain age prediction with lightweight deep neural networks. Med. Image Anal. 68, 101871 (2021)
Pérez-García, F., Sparks, R., Ourselin, S.: TorchIO: a python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning. Comput. Methods Progr. Biomed. 208, 106236 (2021)
Rolls, E.T., Huang, C.C., Lin, C.P., Feng, J., Joliot, M.: Automated anatomical labelling atlas 3. Neuroimage 206, 116189 (2020)
Bintsi, K.-M., Baltatzis, V., Hammers, A., Rueckert, D.: Voxel-level importance maps for interpretable brain age estimation. In: Reyes, M., et al. (eds.) IMIMIC/TDA4MedicalData -2021. LNCS, vol. 12929, pp. 65–74. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87444-5_7
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Shorten, C., Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data 6, 60 (2019)
Springenberg, J.T., Dosovitskiy, A., Brox, T., Riedmiller, M.A.: Striving for simplicity: the all convolutional net. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015, Workshop Track Proceedings (2015)
Todd, K.L., et al.: Ventricular and periventricular anomalies in the aging and cognitively impaired brain. Front. Aging Neurosci. 9, 445 (2018)
Wang, B., Pham, T.D.: MRI-based age prediction using hidden Markov models. J. Neurosci. Methods 199(1), 140–145 (2011)
Acknowledgements
This study was supported by the National Research Foundation of Korea under project BK21 FOUR and grants NRF-2017M3C7A1041824, NRF-2019R1A2C2007612, as well as by Institute of Information & Communications Technology Planning & Evaluation (IITP) grants funded by the Korea government (No. 2017-0-00451, Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning; No. 2019-0-00079, Department of Artificial Intelligence, Korea University; No. 2021-0-02068, Artificial Intelligence Inovation Hub).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Cho, D., Wallraven, C. (2022). Do Pre-processing and Augmentation Help Explainability? A Multi-seed Analysis for Brain Age Estimation. In: Reyes, M., Henriques Abreu, P., Cardoso, J. (eds) Interpretability of Machine Intelligence in Medical Image Computing. iMIMIC 2022. Lecture Notes in Computer Science, vol 13611. Springer, Cham. https://doi.org/10.1007/978-3-031-17976-1_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-17976-1_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17975-4
Online ISBN: 978-3-031-17976-1
eBook Packages: Computer ScienceComputer Science (R0)