Abstract
This paper presents a new technique for the virtual reality (VR) visualization of complex volume images obtained from computer tomography (CT) and Magnetic Resonance Imaging (MRI) by combining three-dimensional (3D) mesh processing and software coding within the gaming engine. The method operates on real representations of human organs avoiding any structural approximations of the real physiological shape. In order to obtain realistic representation of the mesh model, geometrical and topological corrections are performed on the mesh surface with preserving real shape and geometric structure. Using mathematical intervention on the 3D model and mesh triangulation the second part of our algorithm ensures an automatic construction of new two-dimensional (2D) shapes that represent vector slices along any user chosen direction. The final result of our algorithm is developed software application that allows to user complete visual experience and perceptual exploration of real human organs through spatial manipulation of their 3D models. Thus our proposed method achieves a threefold effect: i) high definition VR representation of real models of human organs, ii) the real time generated slices of such a model along any directions, and iii) almost unlimited amount of training data for machine learning that is very useful in process of diagnosis. In addition, our developed application also offers significant benefits to educational process by ensuring interactive features and quality perceptual user experience.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Boundary vertices are often important for shape creation, and algorithm leaves to user a choice of their removing from the mesh.
- 2.
Threshold values of all elimination criteria, including Gaussian and mean curvature values, are adjustable.
- 3.
The face is not divided if the one of vertex belongs to the intersection plane.
- 4.
3D models are downloaded from the website Embodi3D [24].
References
Suttor, J., Marin, J., Verbus, E., Su, M.: Implement AI service into VR training, SPML. In: 2nd International Conference on Signal Processing and Machine Learning, pp. 114–121. Association for Computing Machinery (2019). https://doi.org/10.1145/3372806.3374909
Gluck, A., Chen, J., Paul, R.: Artificial intelligence assisted virtual reality warfighter training system. In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). Utrecht, Netherlands, vol. 1, pp. 386–389. IEEE Computer Society (2020). https://doi.org/10.1109/AIVR50618.2020.00080
Klein, J., et al.: Technical section: visual computing for medical diagnosis and treatment. Comput. Graph. 33(4), 554–565 (2009). https://doi.org/10.1016/j.cag.2009.04.006
Xia, J., et al.: Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery. IEEE Trans. Inf. Technol. Biomed. 5(2), 97–107. IEEE (2001). https://doi.org/10.1109/4233.924800
Ullrich, S., Kuhlen, T.: Haptic palpation for medical simulation in virtual environments. IEEE Trans. Vis. Comput. Graph. 18(4), 617–625. IEEE (2012). https://doi.org/10.1109/TVCG.2012.46
Chang, G., Morreale, P., Medicherla, P.: Applications of augmented reality systems in education. In: Gibson, D., Dodge, B. (eds.) Proceedings of SITE 2010--Society for Information Technology & Teacher Education International Conference, pp. 1380–1385. Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA (2010)
Jeena, R.S., Kumar, S.: A comparative analysis of MRI and CT brain images for stroke diagnosis. In: 2013 Annual International Conference on Emerging Research Areas and 2013 International Conference on Microelectronics, Communications and Renewable Energy, pp. 1–5. IEEE, Kanjirapally, India (2013). https://doi.org/10.1109/AICERA-ICMiCR.2013.6575935
Karani, N., Zhang, L., Tanner, C., Konukoglu, E.: An image interpolation approach for acquisition time reduction in navigator-based 4D MRI. Med. Image Anal. 54, 20–29 (2019). https://doi.org/10.1016/j.media.2019.02.008
Toft, P.A.: The Radon Transform - Theory and Implementation. Technical University of Denmark, Kgs. Lyngby, Denmark (1996)
Fradi, A., Louhichi, B., Mahjoub, M.A, Eynard, B.: 3D Object retrieval based on similarity calculation in 3D computer aided design systems. In: 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA), pp. 160–165. IEEE, Hammamet, Tunisia (2017). https://doi.org/10.1109/AICCSA.2017.101
Cheng, P.C: Handbook of Vascular Motion. Stanford University, CA, United States, Academic Press (2019)
ITK-SNAP: Imaging ToolKit-SNAP, University of Pennsylvania, Philadelphia, Pennsylvania, University of Utah, Salt Lake City, Utah. http://www.itksnap.org
MITK: Medical Imaging Interaction ToolKit, German Cancer Research Center Division of Medical Image Computing, Heidelberg, Germany
3D Slicer, Harvard University, Cambridge, Massachusetts. https://www.slicer.org
Vasic, B.: Ordered Statistics Vertex Extraction and Tracing Algorithm (OSVETA). Adv. Electr. Comput. Eng. 12(4), 25–32 (2012). https://doi.org/10.4316/AECE.2012.04004
Marks, P.: Deep Learning Speeds MRI Scans. Commun. ACM 64(4), 12–14 (2021). https://doi.org/10.1145/3449060
Kerr, J., Ratiu, P., Sellberg, M.: Volume rendering of visible human data for an anatomical virtual environment. Stud. Health Technol. Inf. 29, 352–370 (1996). https://doi.org/10.3233/978-1-60750-873-1-352
Kauffman, M.: Optimizing Your Autodesk® 3ds Max® Design Models for Project Newport. Autodesk University 2009 (2019). http://au.autodesk.com/?nd=material&session_material_id=6296
Faletra, F., Pandian, N., Yen Ho, S.: Anatomy of the Heart by Multislice Computed Tomography. Wiley-Blackwell (2008)
Vasic, I.: Virtual heart application. http://iva.silicon-studio.com/Heartapp.zip
Unity: Multiplatform, Unity Technologies. https://unity.com
Aronberg, D.J., Glazer, H.S., Madsen, K., Sagel, S.S.: Normal thoracic aortic diameters by computed tomography. J. Comput. Assist. Tomogr. 8(2), 247 (1984). PMID: 6707274
Garcier, J.M., Petitcolin, V., Filaire, M., et al.: Normal diameter of the thoracic aorta in adults: a magnetic resonance imaging study. Surg. Radiol. Anat. 25, 322–329 (2003). https://doi.org/10.1007/s00276-003-0140-z
Acknowledgments
The authors sincerely acknowledge the information and suggestions provided by the cardiologist Miomir Randjelovic, Cardiovascular diseases clinic in Nis, Serbia.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Vasic, I., Pierdicca, R., Frontoni, E., Vasic, B. (2021). A New Technique of the Virtual Reality Visualization of Complex Volume Images from the Computer Tomography and Magnetic Resonance Imaging. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-87595-4_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87594-7
Online ISBN: 978-3-030-87595-4
eBook Packages: Computer ScienceComputer Science (R0)