Abstract
Hypertensive intracerebral hemorrhage (HICH) is an intracerebral bleeding disease that affects 2.5 per 10,000 people worldwide each year. An effective way to cure this disease is puncture through the dura with a brain puncture drill and tube; the accuracy of the insertion determines the quality of the surgery. In recent decades, surgical navigation systems have been widely used to improve the accuracy of surgery and minimize risks. Augmented reality– and mixed reality–based surgical navigation is a promising new technology for surgical navigation in the clinic, aiming to improve the safety and accuracy of the operation. In this study, we present a novel multimodel mixed reality navigation system for HICH surgery in which medical images and virtual anatomical structures can be aligned intraoperatively with the actual structures of the patient in a head-mounted device and adjusted when the patient moves in real time while under local anesthesia; this approach can help the surgeon intuitively perform intraoperative navigation. A novel registration method is used to register the holographic space and serves as an intraoperative optical tracker, and a method for calibrating the HICH surgical tools is used to track the tools in real time. The results of phantom experiments revealed a mean registration error of 1.03 mm and an average time consumption of 12.9 min. In clinical usage, the registration error was 1.94 mm, and the time consumption was 14.2 min, showing that this system is sufficiently accurate and effective for clinical application.
Similar content being viewed by others
References
Asberg S, Farahmand B, Henriksson KM et al.: Statins as secondary preventives in patients with intracerebral hemorrhage. International journal of stoke 15(1):61-68,2020
Schlunk F, Chang YC, Ayres A et al.: Blood pressure burden and outcome in warfarin-related intracerebral hemorrhage. International Journal of Stroke 11(8):898-909,2016
JF Zhang, JS Chen, JB Chen.: Influence of surgery with the guideline of minimally invasive concept in prognosis of patients with hypertensive basal ganglia hematomas: a report of 57 cases. Chin J Neuromed 11(4):401–404, 2012
WJ Wang, H Yang.: Clinical analysis on 85 cases of hypertensivecerebral hemorrhage with minimally invasive soft channel technology. Chin Med Pharm 4:31–33,2014
M Ramanan, A Shankar.: Minimally invasive surgery for primary supratentorial intracerebral haemorrhage. J Clin Neurosci 20(12):1650–1658, 2013
Muschelli J, Ullman NL, Sweeney EM: Quantitative Intracerebral Hemorrhage Localization. Stroke 46(11):3270-3280,2015
Chen XJ, Xu L, Wang YP et al.: Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. Journal of Biomedical Informatics 55:124-131,2015
Teatini Andrea, Kumar Rahul P, Elle Ole et al.: Mixed reality as a novel tool for diagnostic and surgical navigation in orthopaedics. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY 16(3):407–414,2021
Fida Benish, Cutolo Fabrizio, Di Franco et al.: Augmented reality in open surgery. UPDATES IN SURGERY 70(3):389-400,2018.
Sakai Daisuke, Joyce Kieran, Sugimoto Maki et al.: Augmented, virtual and mixed reality in spinal surgery: A real-world experience. JOURNAL OF ORTHOPAEDIC SURGERY 28(3),2021
CM Andrews, AB Henry, IM Soriano et al.: Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices. IEEE Journal of Translational Engineering in Health and Medicine 9: pp. 1-14,2021
Emily Rae, Andras Lasso, Matthew S Holden et al.: Neurosurgical burr hole placement using the microsoft hololens. Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling 10576:105760T,2018
Timur Kuzhagaliyev, Neil T Clancy, Mirek Janatka et al.: Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling 10576:1057613,2018
Taylor Frantz, Bart Jansen, Johnny Duerinck et al.: Augmenting Microsoft’s hololens with vuforia tracking for neuronavigation. Healthcare technology Letters 5(5):221–225,2018
Houssam El-Hariri, Prashant Pandey, Antony J Hodgson et al.: Augmented reality visualisation for orthopaedic surgical guidance with pre-and intra-operative multimodal image data fusion. Healthcare Technology Letters 5(5) :189–193,2018
Javed A, Kim YC, Khoo MCK et al.: Dynamic 3-D MR Visualization and Detection of Upper Airway Obstruction During Sleep Using Region Growing Segmentation. IEEE Transactions on biomedical engineering 63(2):431-437,2016
Yang JX, Adu J Chen, HG, Zhang et al.: A Facial Expression Recongnition Method Based On Dlib, RI-LBP and ResNet. 3rd International Conference on Computer Information Science and Application Technology (CISAT),2020
Yang XF, Ye YM, Li XT et al.: Hyperspectral Image Classification with Deep Learning Models. IEEE Transactions on Geoscience and Remote Sensing 56(9):5408-5423,2018
Park JH, Park HW.: Fast view interpolation of stereo images using image gradient and disparity triangulation. Signal Processing-Image Communication 18(5):401-416,2003
Hersch M,Billard A,Bergmann,S.:Iterative Estimation of Rigid-Body Transformations Application to Robust Object Tracking and Iterative Closest Point. JOURNAL OF MATHEMATICAL IMAGING AND VISION 43(1):1-9,2012
Ying SH, Peng JG, Du SY et al.: A Scale Stretch Method based on ICP for 3D data Registration. IEEE Transactions on automation science and engineering 6(3):559-565,2009
Mongen MA, Willems PWA.: Current accuracy of surface matching compared to adhesive markers in patient-to-image registration. Acta Neurochir 161(5):865–870, 2019
Sangkyun Shin, Hyunchul Cho, Siyeop Yoon et al.: Markerless surgical robotic system for intracerebral hemorrhage surgery. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) pp5272–5275,2015
Tao Wang, Quan-Jun Zhao, Jian-Wen Gu, et al.: Neurosurgery medical robot Remobot for the treatment of 17 patients with hypertensive intracerebral hemorrhage. The international journal of medical robotics and computer assisted surgery 15:e2024,2019
Xiaoyao Fan, David W Roberts, Songbai Ji, et al.: Intraoperative fiducial-less patient registration using volumetric 3D ultrasound: a prospective series of 32 neurosurgical cases. J Neurosurg 123:721–731,2015
Li K, Ding XQ, Wang QB, et al.: Low-Cost, Accurate, Effective Treatment of Hypertensive Cerebral Hemorrhage With Three-Dimensional Printing Technology. Frontiers in neurology 12:608403,2021
Yuqian Li, Hongyu Cheng, Zhenzhu Li, et al: Clinical Value of 3D-Printed Navigation Technology Combined with Neuroendoscopy for Intracerebral Hemorrhage. Translational Stroke Research 12:1035-1044, 2021.
van Doormaal TPC, van Doormaal JAM, Mensink T.: Clinical accuracy of holographic navigation using point-based registration on augmented-reality glasses. Oper Neurosurg 17(6):588-593, 2019
Soares I, Sousa RB, Petry M, et al.: Accuracy and repeatability test on Hololens 2 and HTC Vive. Multimodal Technol Interact 5(8):47,2021
Casena C, Carlone L, Carrillo H et al.: Presnet, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age. IEEE Transactions on Robotics 32(6):1309-1332,2016
Lin CC, Tai YC, Lee JJ et al.: A novel point cloud registration using 2D image features. Eurasip Journal on Advances in Signal Processing 5, 2017
Funding
This work was supported by the National Natural Science Foundation of China (No. 81871457), the Scientific and Technology Project of Jinnan District, Tianjin, China (No. 20200110), and the Innovation Foundation for Postgraduate of Tianjin (Grant No.2021YJSB104).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Ethical approval was provided by Ethics Committee of Tianjin Huanhu Hospital (Approval No, JHEC-2021–071).
Informed Consent
Informed consent was obtained from all individual participants included in this study.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhou, Z., Yang, Z., Jiang, S. et al. Surgical Navigation System for Hypertensive Intracerebral Hemorrhage Based on Mixed Reality. J Digit Imaging 35, 1530–1543 (2022). https://doi.org/10.1007/s10278-022-00676-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-022-00676-x