Abstract
In endovascular interventional therapy, automatic common iliac artery morphological analysis can help physicians plan surgical procedures and assist in the selection of appropriate stents to improve surgical safety. However, different people have distinct blood vessel shapes, and many patients have severe malformations of iliac artery due to hemangiomas. Besides, the uneven distribution of contrast media makes it difficult to make an accurate morphological analysis of the common iliac artery. In this paper, a novel fusion network, combining CNN and Transformer is proposed to address the above issues. The proposed FTU-Net consists of a parallel encoder and a Cross-Fusion module to capture and fuse global context information and local representation. Besides, a hybrid decoder module is designed to better adapt the fused features. Extensive experiments have demonstrated that our proposed method significantly outperforms the best previously published results for this task and achieves the state-of-the-art results on the common iliac artery dataset built by us and two other public medical image datasets. To the best of our knowledge, this is the first approach capable of common iliac artery segmentation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kent, K.C.: Abdominal aortic aneurysms. N. Engl. J. Med. 371(22), 2101–2108 (2014)
Buck, D.B., et al.: Endovascular treatment of abdominal aortic aneurysms. Nat. Rev. Cardiol. 11(2), 112 (2014)
Taudorf, M., et al.: Endograft limb occlusion in EVAR: iliac tortuosity quantified by three different indices on the basis of preoperative CTA. Eur. J. Vasc. Endovasc. Surg. 48(5), 527–33 (2014)
Kim, H.O., et al.: Endovascular aneurysm repair for abdominal aortic aneurysm: a comprehensive review. Korean J. Radiol. 20(8), 1247–1265 (2019)
Soomro, T.A., et al.: Deep learning models for retinal blood vessels segmentation: a review. IEEE Access. 7, 71696–71717 (2019)
Meng, C., et al.: Multiscale dense convolutional neural network for DSA cerebrovascular segmentation. Neurocomputing 373, 123–34 (2020)
Zhao, F., Chen, Y., Hou, Y., He, X.: Segmentation of blood vessels using rule-based and machine-learning-based methods: a review. Multimedia Syst. 25(2), 109–118 (2017). https://doi.org/10.1007/s00530-017-0580-7
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems 30 (2017)
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Zheng, S., et al.: Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6881–6890. IEEE (2021)
Xie, E., et al.: SegFormer: simple and efficient design for semantic segmentation with transformers. In: Advances in Neural Information Processing Systems 34 (2021)
Chen, J., et al.: TransUNet: transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306 (2021)
Zhang, Y., Liu, H., Hu, Q.: TransFuse: fusing transformers and CNNs for medical image segmentation. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12901, pp. 14–24. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87193-2_2
Liu, Z., et al.: Swin transformer: Hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9992–10022 (2021)
Huang, Z., et al.: CCNet: criss-cross attention for semantic segmentation. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 603–612. IEEE (2019)
Lee, C-Y., et al.: Deeply-supervised nets. In: Artificial Intelligence and Statistics, pp. 562–570 (2015)
Jha, D., et al.: Kvasir-SEG: a segmented polyp dataset. In: Ro, Y.M., et al. (eds.) MMM 2020. LNCS, vol. 11962, pp. 451–462. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-37734-2_37
Codella, N.C., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 168–172. IEEE (2018)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., Liang, J.: UNet++: a nested U-Net architecture for medical image segmentation. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 3–11. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_1
Oktay, O., et al.: Attention U-Net: learning where to look for the pancreas. arXiv preprint arXiv:1804.03999 (2018)
Zhou, X.H., et al.: Learning skill characteristics from manipulations. IEEE Trans. Neural Netw. Learn. Syst. PP, 1–15 (2022)
Zhou, X.H., et al.: Surgical skill assessment based on dynamic warping manipulations. IEEE Trans. Med. Robot. Bionics 4(1), 50–61 (2022)
Gui, M.J., et al.: Design and experiments of a novel Halbach-cylinder-based magnetic skin: a preliminary study. IEEE Trans. Instrum. Meas. 71, 9502611 (2022)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 62073325, and Grant U1913210; in part by the National Key Research and Development Program of China under Grant 2019YFB1311700; in part by the Youth Innovation Promotion Association of CAS under Grant 2020140; in part by the National Natural Science Foundation of China under Grant 62003343; in part by the Beijing Natural Science Foundation under Grant M22008.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Song, M. et al. (2022). A Novel Fusion Network for Morphological Analysis of Common Iliac Artery. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13437. Springer, Cham. https://doi.org/10.1007/978-3-031-16449-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-16449-1_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16448-4
Online ISBN: 978-3-031-16449-1
eBook Packages: Computer ScienceComputer Science (R0)