Abstract
Colorectal cancer (CRC) is one of the deadliest forms of cancer and is on the rise. Accurate segmentation of the precursor lesion, the polyp, can ensure the survival rate. Hence, there is a research trend to develop medical diagnosis support tool to assist clinicians. This study focuses on the development of deep learning-based CNN model for automated segmentation of polyp. As polyp varies frame to frame in terms of size, color, shape, and texture, segmentation is still an unsolved problem and a very challenging task. We have proposed a multi-scale patch-based CNN model for automatic segmentation of the polyp region. Local and global patches are extracted from each pixel of the input image and fed into two similar CNNs of which one is responsible for the extraction of local features and the other for extraction of global features that are being concatenated for accurately pixel label annotation of the polyp region. As in colonoscopy frames, there are some regions with the same intensity/texture as the polyp regions, so in the predicted segmentation map, some non-polyp regions are also considered as polyp regions, which are further refined by post-processing operation. The proposed model is evaluated on CVC-Clinic DB. The experimental result shows that our proposed method outperforms other baseline CNNs and state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Tabung, F.K., Brown, L.S., Fung, T.T.: Dietary patterns and colorectal cancer risk: a review of 17 years of evidence (2000–2016). Curr. Colorectal Cancer Rep. 13(6), 440–454 (2017)
Bernal, J., et al.: Comparative validation of polyp detection methods in video colonoscopy: results from the MICCAI 2015 endoscopic vision challenge. IEEE Trans. Med. Imaging 36(6), 1231–1249 (2017)
Globocaan: “Cancer Fact sheet,” 1383 [Online]. Available: http://gco.iarc.fr/today/home. Last accessed 2019/8/10
Brandao, P., et al.: Towards a computed-aided diagnosis system in colonoscopy: automatic polyp segmentation using convolution neural networks. J. Med. Robot. Res. 03(02), 1840002 (2018)
Yu, J., Pan, H., Yin, Q., Bian, X., Cui, Q.: Fully convolutional DenseNets for polyp segmentation in colonoscopy. In: 2019 IEEE 35th International Conference on Data Engineering Workshops, pp. 306–311 (2019)
Dijkstra, W., Sobiecki, A., Bernal, J., Telea, A.: Towards a single solution for polyp detection, localization and segmentation in colonoscopy images. In: Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, pp. 616–625 (2019)
Lequan, Y., Hao, C., Qi, D., Jing, Q., Pheng Ann, H.: Integrating online and offline three-dimensional deep learning for automated polyp detection in colonoscopy videos. IEEE J. Biomed. Heal. informatics 21(1), 65–75 (2017)
Sasmal, P., Iwahori, Y., Bhuyan, M.K., Kasugai, K.: Active contour segmentation of polyps in capsule endoscopic images. In: 2018 International Conference on Signals and Systems, pp. 201–204 (2018)
Sánchez-gonzález, A., García-zapirain, B., Sierra-sosa, D., Elmaghraby, A.: Automatized colon polyp segmentation via contour region analysis. Comput. Biol. Med. 100, 152–164 (2018)
Maghsoudi, O.H.: Superpixel based segmentation and classification of polyps in wireless capsule endoscopy. In: 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB), pp. 1–4 (2017)
Guo, Y., Matuszewski, B.: GIANA Polyp Segmentation with Fully Convolutional Dilation Neural Networks. CVML, 632–641 (2019)
Qadir, H.A., Shin, Y., Solhusvik, J., Bergsland, J., Aabakken, L., Balasingham, I.: Polyp detection and segmentation using mask R-CNN : does a deeper feature extractor CNN always perform better? In: 2019 13th International Symposium on Medical Information and Communication Technology, pp. 1–6 (2019)
Farabet, C., Couprie, C., Najman, L., LeCun, Y.: Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1915–1929 (2012)
Sánchez-González, A., Soto, B.G.-Z.: Colonoscopy image pre-processing for the development of computer-aided diagnostic tools. In: Surgical Robotics, IntechOpen (2017)
Zhao, R., Ouyang, W., Li, H., Wang, X.: Saliency detection by multi-context deep learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1265–1274 (2015)
Roy, K., Banik, D., Bhattacharjee, D., Nasipuri, M.: Patch-based system for classification of breast histology images using deep learning. Comput. Med. Imaging Graph. 71, 90–103 (2019)
Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., Vilariño, F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput. Med. Imaging Graph. 43, 99–111 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241 (2015)
Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Pogorelov, K. et al.: Deep learning and hand-crafted feature based approaches for polyp detection in medical videos. In: Proceedings of IEEE Symposium on Computer-Based Medical Systems, pp. 381–386 (2018)
Acknowledgements
The first author is grateful to the Council of Scientific and Industrial Research (CSIR) for providing Senior Research Fellowship (SRF) under the SRF-Direct fellowship program (ACK No. 143416/2K17/1, File No. 09/096(0922)2K18 EMR-I). The second author is thankful to the RUSA 2.0 at Jadavpur University for supporting this work.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Banik, D., Bhattacharjee, D., Nasipuri, M. (2020). A Multi-Scale Patch-Based Deep Learning System for Polyp Segmentation. In: Chaki, R., Cortesi, A., Saeed, K., Chaki, N. (eds) Advanced Computing and Systems for Security. Advances in Intelligent Systems and Computing, vol 1136. Springer, Singapore. https://doi.org/10.1007/978-981-15-2930-6_9
Download citation
DOI: https://doi.org/10.1007/978-981-15-2930-6_9
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2929-0
Online ISBN: 978-981-15-2930-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)