Nothing Special   »   [go: up one dir, main page]

Skip to main content

A New Technique of the Virtual Reality Visualization of Complex Volume Images from the Computer Tomography and Magnetic Resonance Imaging

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12980))

Abstract

This paper presents a new technique for the virtual reality (VR) visualization of complex volume images obtained from computer tomography (CT) and Magnetic Resonance Imaging (MRI) by combining three-dimensional (3D) mesh processing and software coding within the gaming engine. The method operates on real representations of human organs avoiding any structural approximations of the real physiological shape. In order to obtain realistic representation of the mesh model, geometrical and topological corrections are performed on the mesh surface with preserving real shape and geometric structure. Using mathematical intervention on the 3D model and mesh triangulation the second part of our algorithm ensures an automatic construction of new two-dimensional (2D) shapes that represent vector slices along any user chosen direction. The final result of our algorithm is developed software application that allows to user complete visual experience and perceptual exploration of real human organs through spatial manipulation of their 3D models. Thus our proposed method achieves a threefold effect: i) high definition VR representation of real models of human organs, ii) the real time generated slices of such a model along any directions, and iii) almost unlimited amount of training data for machine learning that is very useful in process of diagnosis. In addition, our developed application also offers significant benefits to educational process by ensuring interactive features and quality perceptual user experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Boundary vertices are often important for shape creation, and algorithm leaves to user a choice of their removing from the mesh.

  2. 2.

    Threshold values of all elimination criteria, including Gaussian and mean curvature values, are adjustable.

  3. 3.

    The face is not divided if the one of vertex belongs to the intersection plane.

  4. 4.

    3D models are downloaded from the website Embodi3D [24].

References

  1. Suttor, J., Marin, J., Verbus, E., Su, M.: Implement AI service into VR training, SPML. In: 2nd International Conference on Signal Processing and Machine Learning, pp. 114–121. Association for Computing Machinery (2019). https://doi.org/10.1145/3372806.3374909

  2. Gluck, A., Chen, J., Paul, R.: Artificial intelligence assisted virtual reality warfighter training system. In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). Utrecht, Netherlands, vol. 1, pp. 386–389. IEEE Computer Society (2020). https://doi.org/10.1109/AIVR50618.2020.00080

  3. Klein, J., et al.: Technical section: visual computing for medical diagnosis and treatment. Comput. Graph. 33(4), 554–565 (2009). https://doi.org/10.1016/j.cag.2009.04.006

    Article  Google Scholar 

  4. Xia, J., et al.: Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery. IEEE Trans. Inf. Technol. Biomed. 5(2), 97–107. IEEE (2001). https://doi.org/10.1109/4233.924800

  5. Ullrich, S., Kuhlen, T.: Haptic palpation for medical simulation in virtual environments. IEEE Trans. Vis. Comput. Graph. 18(4), 617–625. IEEE (2012). https://doi.org/10.1109/TVCG.2012.46

  6. Chang, G., Morreale, P., Medicherla, P.: Applications of augmented reality systems in education. In: Gibson, D., Dodge, B. (eds.) Proceedings of SITE 2010--Society for Information Technology & Teacher Education International Conference, pp. 1380–1385. Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA (2010)

    Google Scholar 

  7. Jeena, R.S., Kumar, S.: A comparative analysis of MRI and CT brain images for stroke diagnosis. In: 2013 Annual International Conference on Emerging Research Areas and 2013 International Conference on Microelectronics, Communications and Renewable Energy, pp. 1–5. IEEE, Kanjirapally, India (2013). https://doi.org/10.1109/AICERA-ICMiCR.2013.6575935

  8. Karani, N., Zhang, L., Tanner, C., Konukoglu, E.: An image interpolation approach for acquisition time reduction in navigator-based 4D MRI. Med. Image Anal. 54, 20–29 (2019). https://doi.org/10.1016/j.media.2019.02.008

    Article  Google Scholar 

  9. Toft, P.A.: The Radon Transform - Theory and Implementation. Technical University of Denmark, Kgs. Lyngby, Denmark (1996)

    Google Scholar 

  10. Fradi, A., Louhichi, B., Mahjoub, M.A, Eynard, B.: 3D Object retrieval based on similarity calculation in 3D computer aided design systems. In: 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA), pp. 160–165. IEEE, Hammamet, Tunisia (2017). https://doi.org/10.1109/AICCSA.2017.101

  11. Cheng, P.C: Handbook of Vascular Motion. Stanford University, CA, United States, Academic Press (2019)

    Google Scholar 

  12. ITK-SNAP: Imaging ToolKit-SNAP, University of Pennsylvania, Philadelphia, Pennsylvania, University of Utah, Salt Lake City, Utah. http://www.itksnap.org

  13. MITK: Medical Imaging Interaction ToolKit, German Cancer Research Center Division of Medical Image Computing, Heidelberg, Germany

    Google Scholar 

  14. 3D Slicer, Harvard University, Cambridge, Massachusetts. https://www.slicer.org

  15. Vasic, B.: Ordered Statistics Vertex Extraction and Tracing Algorithm (OSVETA). Adv. Electr. Comput. Eng. 12(4), 25–32 (2012). https://doi.org/10.4316/AECE.2012.04004

    Article  Google Scholar 

  16. Marks, P.: Deep Learning Speeds MRI Scans. Commun. ACM 64(4), 12–14 (2021). https://doi.org/10.1145/3449060

  17. Kerr, J., Ratiu, P., Sellberg, M.: Volume rendering of visible human data for an anatomical virtual environment. Stud. Health Technol. Inf. 29, 352–370 (1996). https://doi.org/10.3233/978-1-60750-873-1-352

    Article  Google Scholar 

  18. Kauffman, M.: Optimizing Your Autodesk® 3ds Max® Design Models for Project Newport. Autodesk University 2009 (2019). http://au.autodesk.com/?nd=material&session_material_id=6296

  19. Faletra, F., Pandian, N., Yen Ho, S.: Anatomy of the Heart by Multislice Computed Tomography. Wiley-Blackwell (2008)

    Google Scholar 

  20. Vasic, I.: Virtual heart application. http://iva.silicon-studio.com/Heartapp.zip

  21. Unity: Multiplatform, Unity Technologies. https://unity.com

  22. Aronberg, D.J., Glazer, H.S., Madsen, K., Sagel, S.S.: Normal thoracic aortic diameters by computed tomography. J. Comput. Assist. Tomogr. 8(2), 247 (1984). PMID: 6707274

    Google Scholar 

  23. Garcier, J.M., Petitcolin, V., Filaire, M., et al.: Normal diameter of the thoracic aorta in adults: a magnetic resonance imaging study. Surg. Radiol. Anat. 25, 322–329 (2003). https://doi.org/10.1007/s00276-003-0140-z

    Article  Google Scholar 

  24. https://www.embodi3d.com/files/

Download references

Acknowledgments

The authors sincerely acknowledge the information and suggestions provided by the cardiologist Miomir Randjelovic, Cardiovascular diseases clinic in Nis, Serbia.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Iva Vasic , Roberto Pierdicca , Emanuele Frontoni or Bata Vasic .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vasic, I., Pierdicca, R., Frontoni, E., Vasic, B. (2021). A New Technique of the Virtual Reality Visualization of Complex Volume Images from the Computer Tomography and Magnetic Resonance Imaging. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87595-4_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87594-7

  • Online ISBN: 978-3-030-87595-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics