Abstract
The purpose of this study is to test the feasibility for deep CNN–based artificial intelligence methods for automatic classification of the mass margin and shape, while radiomic feature–based machine learning methods were also implemented in this study as baseline and for comparison study. In this retrospective study, 596 patients with breast mass that underwent mammography from 4 hospitals were enrolled from January 2012 to October 2019. Margin and shape of each mass were annotated according to BI-RADS by 2 experienced radiologists. Deep CNN–based AI was implemented for the classification task based on Resnet50. Balanced sampler and CBAM were also used to improve the performance of the Deep CNNs. As comparison, image texture features were extracted and then dimensionality reduction methods (such as PCA, ICA) and classical classifiers (such as SVM, DT, KNN) were used for classification task. Based on Python programming software, accuracy (ACC) was used to evaluate the performance of the model, and the model with the highest ACC value was selected. Deep CNN based on Resnet50 with balanced sampler and CBAM achieved the best performance for both margin and shape classification, with ACC of 0.838 and 0.874, respectively. For the radiomics-based machine learning, the best performance for margin was achieved as 0.676 by the combination of FA + RF, while the best performance for shape was 0.802 by the combination of PCA + MLP. The feasibility for automatic classification with coarse labeling of the mass shape and margin was testified with the deep CNN–based AI methods, while radiomic feature–based machine learning methods achieved inferior classification results.
Similar content being viewed by others
References
Ghoncheh M, Pournamdar Z, Salehiniya H. Incidence and Mortality and Epidemiology of Breast Cancer in the World. Asian Pac J Cancer Prev, 2016,17(S3):43-46.
DeSantis C E, Ma J, Goding S A, et al. Breast cancer statistics, 2017, racial disparity in mortality by state. CA Cancer J Clin, 2017,67(6):439-448.
Kim, Saejoon. Margin-maximised redundancy-minimised SVM-RFE for diagnostic classification of mammograms. International Journal of Data Mining & Bioinformatics, 2014,10(4):374-390.
Pharoah P D, Sewell B, Fitzsimmons D, et al. Cost effectiveness of the NHS breast screening programme: life table model. BMJ, 2013,346:f2618.
Tang A, Tam R, Cadrin-Chênevert A, et al. Canadian Association of Radiologists White Paper on Artificial Intelligence in Radiology. Canadian Association of Radiologists Journal, 2018,69(2):120-135..
Jiang F, Jiang Y, Zhi H, et al. Artificial intelligence in healthcare: past, present and future. Stroke & Vascular Neurology, 2017,2(4):230-243.
Lawrence D R, Palacios-Gonzalez C, Harris J. Artificial Intelligence. Camb Q Healthc Ethics, 2016,25(2):250-261.
Mahersia H, Boulehmi H, Hamrouni K. Development of intelligent systems based on Bayesian regularization network and neuro-fuzzy models for mass detection in mammograms: A comparative analysis. Comput Methods Programs Biomed, 2016,126:46-62.
Bargalló X, Santamaría G, Del Amo M, et al. Single reading with computer-aided detection performed by selected radiologists in a breast cancer screening program. European Journal of Radiology, 2014,83(11):2019-2023.
Balleyguier C, Ayadi S, Nguyen K V, et al. BIRADS classification in mammography. European Journal of Radiology, 2007,61(2):192-194.
Weiqiang Z, Xiangmin X, Wei H. Shape and Boundary Analysis for Classification of Breast Masses: International Symposium on Computational Intelligence & Design, 2008[C].
Rangayyan R M, Mudigonda N R, Desautels J E L. Boundary modelling and shape analysis methods for classification of mammographic masses. Medical & Biological Engineering & Computing, 2000,38(5):487-496.
Wu Y, Wei J, Hadjiiski L M, et al. Bilateral analysis based false positive reduction for computer-aided mass detection. Medical Physics, 2007,34(8):3334-3344.
Li H D, Kallergi M. Markov random field for tumor detection in digital mammography. IEEE Transactions on Medical Imaging, 1995,14(3):565-576.
Fedorov A, Beichel R, Kalpathy-Cramer J, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magnetic Resonance Imaging, 2012,30(9):1323-1341.
Elezaby M, Li G, Bhargavan-Chatfield M, et al. ACR BI-RADS Assessment Category 4 Subdivisions in Diagnostic Mammography: Utilization and Outcomes in the National Mammography Database. Radiology, 2018,287(2):416-422.
Griethuysen J J V, Fedorov A, Parmar C, et al. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res, 2017, 77(21):e104-e107..
Gao H, Zhuang L, Laurens V D M, et al. Densely Connected Convolutional Networks: CVPR, 2017[C].
Tan M, Le Q V. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. 2019.
Torch extractor: PyTorch Intermediate Feature extraction. https://github.com/antoinebrl/torchextractor.
Funding
This work was mainly supported by the National Natural Science Foundation of China (grant number 81671743), the Clinical Key Diseases Diagnosis and Therapy Special Project of Health and Family Planning Commission of Suzhou (LCZX201801), the Program for Advanced Talents within Six Industries of Jiangsu province (WSW-057), the High-level Health Personnel “six-one” Project of Jiangsu province in China (LGY2016035), the Livelihood Technology Project of Health and Family Planning Commission of Suzhou (SYSD2020074), and Applied Basic Research Project in Suzhou (SYS2018083).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Longxiu Qi, Hailin Shen, and Qilei Gao: investigation, data curation, visualization, writing original draft. Zhigang Han, Jianguo Zhu, and You Meng: data curation and data analysis. Xing Lu: software development, data analysis, and editing. Yonggang Li, Linhua Wang, and Shuangqing Chen: investigation, supervision, review, and editing. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics Approval and Consent to Participate
This multicenter study was approved by the ethics committee of every participating hospital and was conducted in accordance with the Declaration of Helsinki. The requirement for patient informed consent was waived.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Qi, L., Lu, X., Shen, H. et al. Automatic Classification of Mass Shape and Margin on Mammography with Artificial Intelligence: Deep CNN Versus Radiomics. J Digit Imaging 36, 1314–1322 (2023). https://doi.org/10.1007/s10278-023-00798-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-023-00798-w