Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Augmented reality navigation for minimally invasive knee surgery using enhanced arthroscopy

Published: 01 April 2021 Publication History

Highlights

Α novel in-situ AR navigation based on the enhanced arthroscopic information is developed to solve the existed problems of in-situ AR navigation.
This system uses tissue properties-based model deformation method to update the 3D preoperative knee model.
Preclinical experiments on knee phantom and in-vitro swine knee demonstrate the effectiveness the proposed in-situ AR navigation.

Abstract

Purpose

During the minimally invasive knee surgery, surgeons insert surgical instruments and arthroscopy through small incisions, and implement treatment assisted by 2D arthroscopic images. However, this 2D arthroscopic navigation faces several problems. Firstly, the guidance information is displayed on a screen away from the surgical area, which makes hand/eye coordination difficult. Secondly, the small incision limits the surgeons to view the internal knee structures only from an arthroscopic camera. In addition, arthroscopic images commonly appear obscure visions.

Methods

To solve these problems, we proposed a novel in-situ augmented reality navigation system with the enhanced arthroscopic information. Firstly, intraoperative anatomical locations were obtained by using arthroscopic images and arthroscopy calibration. Secondly, tissue properties-based model deformation method was proposed to update the 3D preoperative knee model with anatomical location information. Then, the updated model was further rendered with glasses-free real 3D display for achieving the global in-situ augmented reality view. In addition, virtual arthroscopic images were generated from the updated preoperative model to provide the anatomical information of the operation area.

Results

Experimental results demonstrated that virtual arthroscopic images could reflect the correct structure information with a mean error of 0.32 mm. Compared with 2D arthroscopic navigation, the proposed augmented reality navigation reduced the targeting errors by 2.10 mm and 2.70 mm for the experiments of knee phantom and in-vitro swine knee, respectively.

Conclusion

Our navigation method is helpful for minimally invasive knee surgery since it can provide the global in-situ information and detail anatomical information.

References

[1]
R. Treuting, Minimally invasive orthopedic surgery: arthroscopy, Ochsner J. 2 (3) (2000) 158–163.
[2]
L. Bigony, Arthroscopic surgery: a historical perspective, Orthop. Nurs. 27 (6) (2008) 349–354.
[3]
W.N. Lo, K.W. Cheung, S.H. Yung, et al., Arthroscopy-assisted computer navigation in high tibial osteotomy for varus knee deformity (2009), J. Orthop. Surg. 17 (1) (2009) 51–55.
[4]
D.T. Felson. Arthroscopy as a treatment for knee osteoarthritis (2010). 24 (1):47-50.
[5]
Maculé F., Lozano L. Arthroscopic-Assisted, Navigated Triplane Osteotomies of the Lower Extremity[M] (2013)// Knee Surgery using Computer Assisted Surgery and Robotics. Springer, Berlin, Heidelberg,137-142.
[6]
J.N. Katz, S.A. Brownlee, M.H. Jones, The role of arthroscopy in the management of knee osteoarthritis, Best Pract. Res. Clin. Rheumatol. 28 (1) (2014) 143–156.
[7]
D. Hernández-Vaquero, M. Fernández-Fairen, A. Torres-Perez, Minimally invasive surgery versus conventional surgery. A review of the scientific evidence, Revista Española de Cirugía Ortopédica y Traumatología (English Edition) 56 (6) (2012) 444–458.
[8]
P.A. Heng, C.Y. Cheng, T.T. Wong, Y.S. Xu, Y.P. Chui, K.M. Chan, S.K.A. Tso, Virtual-reality training system for knee arthroscopic surgery, in: IEEE Transactions on Information Technology in Biomedicine, 8, 2004, pp. 217–227.
[9]
M. Sati, H.U. Stäubli, M.Y. Bourquin, M.M. Kunz, Clinical integration of computer-assisted technology for arthroscopic anterior cruciate ligament reconstruction, Oper. Tech. Orthop. 10 (1) (2000) 40–49.
[10]
E.J. Hazan, Computer-assisted orthopaedic surgery: a new paradigm, Tech. Orthop. 18 (2) (2003) 221–229.
[11]
F. Picard, A.M. DiGioia, V. Martinek, Accuracy in tunnel placement for ACL reconstruction. Comparison of traditional arthroscopic and computer-assisted navigation techniques, Comput. Aided Surg. 6 (5) (2001) 279–289.
[12]
O. Tonet, G. Megali, S. D'Attanasio, An augmented reality navigation system for computer assisted arthroscopic surgery of the knee, in: International Conference on Medical Image Computing & Computer-assisted Intervention, 2000.
[13]
D.H. Nawabi, N. Mehta, Learning curve for hip arthroscopy steeper than ex-pected, J. Hip Preserv. Surg. 5 (4) (2000) 11–19.
[14]
C. Raposo, C. Sousa, L. Ribeiro, F. Fonseca, Video-based computer aided arthroscopy for patient specific reconstruction of the anterior cruciate ligament[C], in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, Cham, 2018, pp. 125–133.
[15]
O. Reigstad, C. Grimsgaard, Complications in knee arthroscopy, Knee Surg. Sports Traumatol. Arthrosc. 14 (5) (2006) 473–477.
[16]
W. Lo, K. Cheung, S. Yung, K.H. Chiu, Arthroscopy-assisted computer navigation in high Tibial osteotomy for Varus knee deformity, J. Orthop. Surg. 17 (1) (2009) 51–55.
[17]
J.M. Li, D.D. Bardana, A.J. Stewart, Augmented virtuality for arthroscopic knee surgery[M], Medical Image Computing and Computer-Assisted Intervention – MICCAI 2011, Springer, Berlin Heidelberg, 2011.
[18]
W. Zhu, W. Lu, Y. Han, S. Hui, Y. Ou, Application of a computerised navigation technique to assist arthroscopic anterior cruciate ligament reconstruction, Int. Orthop. 37 (2) (2013) 233–238.
[19]
M.J. Salzler, A. Lin, C.D. Miller, Complications after arthroscopic knee surgery (2014), Am. J. Sports Med. 42 (2) (2014) 292–296.
[20]
J.B. Thorlund, C.B. Juhl, E.M. Roos, et al., Arthroscopic surgery for degenerative knee: systematic review and meta-analysis of benefits and harms, Br. J. Sports Med. 350 (2015) h2747.
[21]
S. Bernhardt, S.A. Nicolau, L. Soler, C. Doignon, The status of augmented reality in laparoscopic surgery as of 2016, Med. Image Anal. 37 (2017) 66–90.
[22]
D.B. Douglas, C.A. Wilke, D. Gibson, et al., Virtual reality and augmented reality: advances in surgery, IEEE Eng. Med. Biol. 2 (2017) 1–8.
[23]
M. Kersten-Oertel, P. Jannin, D.L. Collins, The state of the art of visualization in mixed reality image guided surgery, Comput. Med. Imaging Graph. 37 (2) (2013) 98–112.
[24]
X. Zhang, G. Chen, H. Liao, High-quality see-through surgical guidance system using enhanced 3-D autostereoscopic augmented reality, IEEE Trans. Biomed. Eng. 64 (8) (2016) 1815–1825.
[25]
L Ma, Z Fan, G Ning, et al., 3D visualization and augmented reality for orthopedics[M], Intelligent Orthopaedics (2018) 193–205.
[26]
H. Liao, T. Inomata, I. Sakuma, T. Dohi, 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay, IEEE Trans. Biomed. Eng. 57 (6) (2010) 1476–1486.
[27]
L. Ma, W. Jiang, B. Zhang, X. Qu, G. Ning, X. Zhang, H. Liao, Augmented reality surgical navigation with accurate CBCT-patient registration for dental implant placement, Med. Biol. Eng. Comput. 57 (1) (2019) 47–57.
[28]
L. Ma, Z. Zhao, F. Chen, B. Zhang, L. Fu, H. Liao, Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study, Int. J. Comput. Assist. Radiol. Surg. 12 (12) (2017) 2205–2215.
[29]
W. Sumner R, Deformation Transfer for Triangle Meshes[C]// Acm Siggraph, ACM, 2004.
[30]
T.A. Davis, Algorithm 832: UMFPACK V4.3—an unsymmetric-pattern multifrontal method (2004), Acm Trans. Math. Softw. 30 (2) (2004) 196–199.
[31]
H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, T. Dohi, Surgical navigation by autostereoscopic image overlay of integral videography, IEEE Trans. Inf. Technol. Biomed. 8 (2) (2004) 114–121.
[32]
X.Q. Lu, C.L. Wang, Y. Gu, D.Z. Jia, The study and implementation of virtual endoscopy based on VTK 3D surface rendering, Appl. Mech. Mater. 7 (5) (2018) 31–41.
[33]
Q. Sun, Y. Mai, R. Yang, et al., Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens, Int. J. Comput. Assist. Radiol. Surg. 15 (5) (2020) 1907–1919.
[34]
M. Keisuke, W. Eiju, K. Taichi, et al., Smart glasses for neurosurgical navigation by augmented reality.[J], Oper. Neurosurg. 10 (5) (2018) 5–21.
[35]
G. Badiali, L. Cercenelli, S. Battaglia, et al., Review on augmented reality in oral and Cranio-Maxillofacial surgery: towards "surgery-specific" head-up displays[J], IEEE Access (99) (2020) 1.
[36]
A.S. Vemuri, C.H. Wu, K.C. Liu, et al., Deformable three-dimensional model architecture for interactive augmented reality in minimally invasive surgery[J], Surg. Endosc. 26 (12) (2012) 3655–3662.

Cited By

View all
  • (2023)Augmented reality-based surgical guidance for wrist arthroscopy with bone-shift compensationComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2022.107323230:COnline publication date: 1-Mar-2023
  • (2022)Augmented Reality Based Video Shooting Guidance for Novice UsersProceedings of the ACM on Human-Computer Interaction10.1145/35467506:MHCI(1-20)Online publication date: 20-Sep-2022
  • (2022)Multi-Modality guidance based surgical navigation for percutaneous endoscopic transforaminal discectomyComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2021.106460212:COnline publication date: 23-Apr-2022

Index Terms

  1. Augmented reality navigation for minimally invasive knee surgery using enhanced arthroscopy
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Computer Methods and Programs in Biomedicine
          Computer Methods and Programs in Biomedicine  Volume 201, Issue C
          Apr 2021
          162 pages

          Publisher

          Elsevier North-Holland, Inc.

          United States

          Publication History

          Published: 01 April 2021

          Author Tags

          1. Knee surgery
          2. Augmented reality
          3. Arthroscopic image
          4. Enhanced information

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 18 Dec 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2023)Augmented reality-based surgical guidance for wrist arthroscopy with bone-shift compensationComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2022.107323230:COnline publication date: 1-Mar-2023
          • (2022)Augmented Reality Based Video Shooting Guidance for Novice UsersProceedings of the ACM on Human-Computer Interaction10.1145/35467506:MHCI(1-20)Online publication date: 20-Sep-2022
          • (2022)Multi-Modality guidance based surgical navigation for percutaneous endoscopic transforaminal discectomyComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2021.106460212:COnline publication date: 23-Apr-2022

          View Options

          View options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media