research-article

Overlay of patient-specific anatomical data for advanced navigation in surgery simulation

Authors:

Rüdiger Mecke,

Bernhard PreimAuthors Info & Claims

IWDE '10: Proceedings of the First International Workshop on Digital Engineering

Pages 52 - 58

https://doi.org/10.1145/1837154.1837162

Published: 14 June 2010 Publication History

Abstract

This paper introduces a method to integrate patient specific anatomical image data into our surgery simulation. The image data can be used to plan the next steps within the simulated surgery intervention. The anatomical images are presented with in anatomical directions, but also plane parallel and orthogonal. The camera orthogonal view is intended to give an overview over the operational field and to explore the anatomical structures for the current point of view. The plane parallel view is used to recognize changes of tissue in the direction of infiltration to avoid injuries during interaction. We support basic histogram manipulation and augmentation in real time by using advanced rendering techniques, no additional computation time is required during rendering. The presented method supports apprenticeship and training of surgeons when interacting within a simulated intervention, but is also useful for the training of the interpretation of the medical images, because the anatomical data and the related images can be explored without any risk to the patient. With the introduction of target points to mark and augment regions of interests we support advanced guidance to those points, whereas the location of the augmentation is visible within multiple viewports.

References

[1]

W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, and H. Bergmann. A Head-Mounted Operating Binocular for Augmented Reality Visualization in Medicine-Design and Initial Evaluation. IEEE Transactions on Medical Imaging, 21(8):991--997, 2002.

[2]

M. Caversaccio, J. Garcia-Giraldez, M. Gonzalez-Ballester, and G. Marti. Image-Guided Surgical Microscope with Mounted Minitracker. Journal of Laryngology & Otology, 121(2):160--162, 2007.

[3]

S. Cotin, H. Delingette, and N. Ayache. Real-time elastic deformations of soft tissues for surgery simulation. IEEE Transactions on Visualization and Computer Graphics, 5(1):62--73, 1999.

Digital Library

[4]

H. Delingette. Towards realistic soft tissue modeling in medical simulation. In Proceedings of the IEEE, pages 512--523, 2000.

[5]

H. Delingette, S. Cotin, and N. Ayache. A hybrid elastic model allowing real-time cutting, deformations and force-feedback for surgery training and simulation. In CA '99: Proceedings of the Computer Animation, page 70, Washington, DC, USA, 1999. IEEE Computer Society.

Digital Library

[6]

P. Edwards, A. King, C. Maurer, D. de Cunhal, D. Hawkes, D. Hill, R. Gaston, M. Fenlon, S. Chandra, A. Strong, C. Chandler, A. Richards, and M. Gleeson. Design and Evaluation of a System for Microscope-Assisted Guided Interventions (MAGI). IEEE Transactions on Medical Imaging, 19(11):1082--1093, 2000.

[7]

M. Feuerstein, T. Mussack, S. Heining, and N. Navab. Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection. IEEE Trans. Med. Imag., 27(3):355--369, March 2008.

[8]

J. Fischer, A. del Río, M. Neff, S. Flossmann, F. Duffner, J. Hoffmann, W. Straßer, and D. Bartz. The ARGUS System: Surgical Mixed Reality based on Image Guided Surgery, Extensions, and Applications. In Proc. of Computer-Aided Surgery around the Head (CAS-H), 2007.

[9]

D. E. Huber and C. G. Healey. Visualizing data with motion. In IEEE Visualization, page 67, 2005.

[10]

P. Kelly, G. Alker, and S. Goerss. Computer-Assisted Stereotactic Microsurgery for the Treatment of Intracranial Neoplasms. Journal of Neurosurgery, 10(3):324--331, 1982.

[11]

A. King, P. Edwards, C. Maurer, D. Cunha, R. Gaston, M. Clarkson, D. Hill, D. Hawkes, M. Fenlon, A. Strong, T. Cox, and M. Gleeson. Stereo Augmented Reality in the Surgical Microscope. Presence: Teleoper. Virtual Environ, 9(4):360--368, 2000.

Digital Library

[12]

U. Kühnapfel, H. Çakmak, and H. MaaSS. Endoscopic surgery training using virtual reality and deformable tissue simulation. In Computers & Graphics, volume 24, pages 671--682, 2000.

[13]

U. Kühnapfel, C. Kuhn, M. Hübner, H. Krumm, and B. Neisius. Cad-based simulation and modelling for endoscopic surgery. In Proc. MedTech., SMIT, Berlin, October 1994. Institut für Angewandte Informatik, Kernforschungszentrum Karlsruhe, Germany.

[14]

R. Lapeer, M. Chen, G. Gonzalez, A. Linney, and G. Alusi. Image-Enhanced Surgical Navigation for Endoscopic Sinus Surgery: Evaluating Calibration, Registration and Tracking. The International Journal of Medical Robotics and Computer Assisted Surgery, 4(1):32--452, 2008.

[15]

C. Maurer, Jr., F. Sauer, B. Hu, B. Bascle, B. Geiger, F. W. and. F. Recchi, T. Rohlfing, C. Brown, R. Bakos, R. Maciunas, and A. Bani-hashemi. Augmented Reality Visualization of Brain Structures with Stereo and Kinetic Depth Cues: System Description and Initial Evaluation with Head Phantom. In In SPIE Proceedings Series, pages 445--456, 2001.

[16]

G. Picinbono, J.-C. Lombardo, H. Delingette, and N. Ayache. Anisotropic elasticity and force extrapolation to improve realism of surgery simulation. In ICRA, pages 596--602, 2000.

[17]

G. Picinbono, J.-C. Lombardo, H. Delingette, and N. Ayache. Improving realism of a surgery simulator: linear anisotropic elasticity, complex interactions and force extrapolation. Journal of Visualization and Computer Animation, 13(3):147--167, 2002.

[18]

D. Roberts, J. Strohbehn, J. Hatch, W. Murray, and H. Kettenberger. A Frameless Stereotaxic Integration of Computerized Tomographic Imaging and the Operating Microscope. Journal of Neurosurgery, 56(4):545--549, 1986.

[19]

M. Rosenthal, A. Statea, J. Leea, G. Hirotab, J. Ackermana, K. Kellera, E. Pisanoc, M. Jiroutekd, K. Mullerd, and H. Fuchsa. Augmented Reality Guidance for Needle Biopsies: An Initial Randomized, Controlled Trial in Phantoms. Mdical image Analysis, 6(3):313--320, 2002.

[20]

T. Salb, J. Brief, O. Burgert, T. Gockel, S. Hassfeld, J. Mühling, and R. Dillmann. Intraoperative Presentation of Surgical Planning and Simulation Results using a Stereoscopic See-Through Head-Mounted Display. In In SPIE Electronic Imaging. International Conference on Stereoscopic Displays and Virtual Reality Systems, pages 68--75. SPIE Press, 2000.

[21]

R. Shahidi, M. R. Bax, C. Maurer, J. Johnson, E. Wilkinson, B. Wang, J. West, M. Citardi, K. Manwaring, and R. Khadem. Implementation, Calibration and Accuracy Testing of an Image-Enhanced Endoscopy System. IEEE Transactions on Medical Imaging, 21(12):1524--1535, 2002.

[22]

T. Sielhorst, M. Feuerstein, and N. Navab. Advanced Medical Displays: A Literature Review of Augmented Reality. Journal of Display Technology, 4(4):451--467, 2008.

[23]

F. Wacker, S. Vogt, A. Khamene, J. Jesberger, S. Nour, D. Elgort, F. Sauer, J. Duerk, and J. Lewin. An Augmented Reality System for MR Image-guided Needle Biopsy: Initial Results in a Swine Model. Radiology, 238(2):497--504, 2006.

Cited By

Paul G(2021)MODELING AND SIMULATION OF HUMAN SYSTEMSHandbook of Human Factors and Ergonomics10.1002/9781119636113.ch27(704-735)Online publication date: 13-Aug-2021
https://doi.org/10.1002/9781119636113.ch27
Ceneda DGschwandtner TMiksch S(2019)A Review of Guidance Approaches in Visual Data Analysis: A Multifocal PerspectiveComputer Graphics Forum10.1111/cgf.1373038:3(861-879)Online publication date: 10-Jul-2019
https://doi.org/10.1111/cgf.13730

Index Terms

Overlay of patient-specific anatomical data for advanced navigation in surgery simulation
1. Applied computing
  1. Education
  2. Life and medical sciences
    1. Health care information systems
2. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering
  2. Modeling and simulation
    1. Simulation types and techniques
      1. Simulation by animation

Recommendations

Towards an anatomical modeling pipeline for simulation and accurate navigation for brain and spine surgery
SummerSim '17: Proceedings of the Summer Simulation Multi-Conference

This paper summarizes work underway on neurosurgery simulation and navigation, emphasizing anatomical modeling techniques and clinical requirements for simulation. We describe innovations that center on patient-specific anatomical modeling of the brain, ...
Interactive surgery simulation for the nose augmentation using CT data

Surgery to reshape the nose with an implant has been a regular procedure for enhancing a patient’s appearance and self-confidence. The purpose of this study was to establish a computed tomography (CT) based three-dimensional assistant plastic surgery ...
Augmented reality navigation for minimally invasive knee surgery using enhanced arthroscopy
Highlights
- Α novel in-situ AR navigation based on the enhanced arthroscopic information is developed to solve the existed problems of in-situ AR navigation.
Abstract Purpose
During the minimally invasive knee surgery, surgeons insert surgical instruments and arthroscopy through small incisions, and implement treatment assisted by 2D arthroscopic images. However, this 2D arthroscopic ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IWDE '10: Proceedings of the First International Workshop on Digital Engineering

June 2010

72 pages

ISBN:9781605589923

DOI:10.1145/1837154

Editors:
Gunter Saake
Otto-von-Guericke University Magdeburg, Germany
,
Veit Köppen

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

IWDE '10

IWDE '10: 1st International Workshop on Digital Engineering

June 14, 2010

Magdeburg, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
250
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Paul G(2021)MODELING AND SIMULATION OF HUMAN SYSTEMSHandbook of Human Factors and Ergonomics10.1002/9781119636113.ch27(704-735)Online publication date: 13-Aug-2021
https://doi.org/10.1002/9781119636113.ch27
Ceneda DGschwandtner TMiksch S(2019)A Review of Guidance Approaches in Visual Data Analysis: A Multifocal PerspectiveComputer Graphics Forum10.1111/cgf.1373038:3(861-879)Online publication date: 10-Jul-2019
https://doi.org/10.1111/cgf.13730

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents