Nothing Special   »   [go: up one dir, main page]

Skip to main content

The Comparison Analysis of the Cervical Features Between Second-and Third-Trimester Pregnancy in Ultrasound Images Using eXplainable AI

  • Conference paper
  • First Online:
Perinatal, Preterm and Paediatric Image Analysis (PIPPI 2023)

Abstract

The fetus is maintained in the uterus by the cervix throughout pregnancy. In the last period of pregnancy, the cervix softens, shortens, and expands in preparation for labor. When most clinicians check for changes in the cervix, like softness, they use palpation. However, since this palpation causes discomfort to the mother, we want to compare the status of the area around the cervical canal according to the pregnancy period through ultrasound images only. Therefore, we trained the deep learning network model and obtained high performance for the second and third-trimester classifications. Further, we used explainable Artificial Intelligence (XAI) techniques (i.e., Grad-CAM/Grad-CAM++, Score-CAM, Eigen-CAM) in order to find which areas were important features during the deep learning network training. As a result, in the third-trimester period images, it was seen that the fetal head was a major feature, however, it was found that the cervix and cervical border were also affected without a fetal head. Also, it was determined that the classification in the second-trimester images was based on the potential region toward the lower uterus from the internal os. By analyzing the deep learning network result using the XAI approaches, this might be used as a new feature to describe the cervical change.

Y.-E. Jeon and G.-H. Son—These authors contributed equally to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.R., Samek, W.: On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 10(7), e0130140 (2015)

    Article  Google Scholar 

  2. Chattopadhay, A., Sarkar, A., Howlader, P., Balasubramanian, V.N.: Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 839–847. IEEE (2018)

    Google Scholar 

  3. Cook, C.M., Ellwood, D.: A longitudinal study of the cervix in pregnancy using transvaginal ultrasound. BJOG: An International J. Obstetrics & Gynaecology 103(1), 16–18 (1996)

    Google Scholar 

  4. Dagle, A.B., et al.: Automated segmentation of cervical anatomy to interrogate preterm birth. In: Licandro, R., Melbourne, A., Abaci Turk, E., Macgowan, C., Hutter, J. (eds.) Perinatal, Preterm and Paediatric Image Analysis: 7th International Workshop, PIPPI 2022, Held in Conjunction with MICCAI 2022, Singapore, September 18, 2022, Proceedings, pp. 48–59. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-17117-8_5

    Chapter  Google Scholar 

  5. García Ocaña, M.I., López-Linares Román, K., Burgos San Cristóbal, J., del Campo Real, A., Macía Oliver, I.: Prediction of failure of induction of labor from ultrasound images using radiomic features. In: Wang, Q., Gomez, A., Hutter, J., McLeod, K., Zimmer, V., Zettinig, O., Licandro, R., Robinson, E., Christiaens, D., Turk, E.A., Melbourne, A. (eds.) PIPPI/SUSI -2019. LNCS, vol. 11798, pp. 153–160. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32875-7_17

    Chapter  Google Scholar 

  6. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  7. Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)

    Google Scholar 

  8. Hughey, M.J.: Fetal position during pregnancy. Am. J. Obstet. Gynecol. 153(8), 885–886 (1985)

    Article  Google Scholar 

  9. Kilpatrick, S., Garrison, E.: Normal labor and delivery. Obstetrics: Normal Problem pregnancies 5, 303–321 (2007)

    Google Scholar 

  10. Montavon, G., Lapuschkin, S., Binder, A., Samek, W., Müller, K.R.: Explaining nonlinear classification decisions with deep Taylor decomposition. Pattern Recogn. 65, 211–222 (2017)

    Article  Google Scholar 

  11. Muhammad, M.B., Yeasin, M.: Eigen-cam: Class activation map using principal components. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE (2020)

    Google Scholar 

  12. Myers, K.M., et al.: The mechanical role of the cervix in pregnancy. J. Biomech. 48(9), 1511–1523 (2015)

    Article  Google Scholar 

  13. Nott, J.P., Bonney, E.A., Pickering, J.D., Simpson, N.A.: The structure and function of the cervix during pregnancy. Trans. Res. Anat. 2, 1–7 (2016)

    Google Scholar 

  14. Popowski, T., Porcher, R., Fort, J., Javoise, S., Rozenberg, P.: Influence of ultrasound determination of fetal head position on mode of delivery: a pragmatic randomized trial (2015)

    Google Scholar 

  15. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)

    Google Scholar 

  16. Son, G.H., You, Y.A., Kwon, E.J., Lee, K.Y., Kim, Y.J.: Comparative analysis of midtrimester amniotic fluid cytokine levels to predict spontaneous very pre-term birth in patients with cervical insufficiency. Am. J. Reprod. Immunol. 75(2), 155–161 (2016)

    Article  Google Scholar 

  17. Spong, C.Y.: Prediction and prevention of recurrent spontaneous preterm birth. Obstet. Gynecol. 110(2 Part 1), 405–415 (2007)

    Google Scholar 

  18. Spong, C.Y.: Defining “term” pregnancy: recommendations from the defining “term” pregnancy workgroup. JAMA 309(23), 2445–2446 (2013)

    Google Scholar 

  19. Tan, M., Le, Q.: Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning, pp. 6105–6114. PMLR (2019)

    Google Scholar 

  20. Turek, M.: Explainable artificial intelligence (xai) (archived). https://www.darpa.mil/program/explainable-artificial-intelligence

  21. Wang, H., et al.: Score-cam: Score-weighted visual explanations for convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 24–25 (2020)

    Google Scholar 

  22. Włodarczyk, T., et al.: Estimation of preterm birth markers with u-net segmentation network. In: Wang, Q., et al. (eds.) PIPPI/SUSI -2019. LNCS, vol. 11798, pp. 95–103. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32875-7_11

    Chapter  Google Scholar 

  23. Yost, N.P., et al.: Second-trimester cervical sonography: features other than cervical length to predict spontaneous preterm birth. Obstet. Gynecol. 103(3), 457–462 (2004)

    Article  Google Scholar 

  24. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921–2929 (2016)

    Google Scholar 

Download references

Acknowledgment

This work was supported by the Korea Medical Device Development Fund grant funded by the Korea government (the Ministry of Science and ICT (MSIT), the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety) (No. 1711139109, KMDF_PR_20210527_0005) and partly supported by the Bio &Medical Technology Development Program of the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. RS-2023-00223501).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dong-Ok Won .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jeon, YE., Son, GH., Kim, HJ., Lee, JJ., Won, DO. (2023). The Comparison Analysis of the Cervical Features Between Second-and Third-Trimester Pregnancy in Ultrasound Images Using eXplainable AI. In: Link-Sourani, D., Abaci Turk, E., Macgowan, C., Hutter, J., Melbourne, A., Licandro, R. (eds) Perinatal, Preterm and Paediatric Image Analysis. PIPPI 2023. Lecture Notes in Computer Science, vol 14246. Springer, Cham. https://doi.org/10.1007/978-3-031-45544-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45544-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45543-8

  • Online ISBN: 978-3-031-45544-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics