Abstract
Minimally invasive mitral valve repair is a common cardiac surgery procedure. Combining intraoperative stereo-endoscopic images with pre-operative 4D transesophageal echocardiography (TEE) can support surgeons in correlating surgical interventions with the functional implications in the beating heart. We propose a method for registering 3D point clouds reconstructed from endoscopic images with TEE by extracting and matching anatomical landmarks and refining the registration using the Iterative Closest Point Algorithm. The applicability of our method is assessed by the computation time and the registration accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jones EC, Devereux RB, Roman MJ, et al. Prevalence and correlates of mitral regurgitation in a population-based sample (the Strong Heart Study). Am J Cardiol. 2001;87(3):298–304.
Dziadzko V, Dziadzko M, Medina-Inojosa JR, Benfari G, et al. Causes and mechanisms of isolated mitral regurgitation in the community: clinical context and outcome. Eur Heart J. 2019;40(27):2194–202.
Beckmann A, Meyer R, Lewandowski J, et al. German Heart Surgery Report 2021: the annual updated registry of the German Society for Thoracic and Cardiovascular Surgery. Thorac Cardiovasc Surg. 2022;70(05):362–76.
Jacobs S, Sündermann SH. Minimally invasive valve sparing mitral valve repair—the loop technique—how we do it. Ann Cardiothorac Surg. 2013;2(6):818–24.
Nanchahal S, Arjomandi Rad A, Naruka V, et al. Mitral valve surgery assisted by virtual and augmented reality: cardiac surgery at the front of innovation. Perfusion. 2022.
Engelhardt S, De Simone R, Zimmermann N, et al. Augmented reality-enhanced endoscopic images for annuloplasty ring sizing. Augment Environ Comput Assist Interv (2014). Cham: Springer International, 2014:128–37.
Ender J, Končar-Zeh J, Mukherjee C, et al. Value of augmented reality-enhanced transesophageal echocardiography (TEE) for determining optimal annuloplasty ring size during mitral valve repair. Ann Thorac Surg. 2008;86(5):1473–8.
Ivantsits M, Tautz L, Sündermann S, et al. DL-based segmentation of endoscopic scenes for mitral valve repair. CDBME. 2020;6(1).
Andreassen BS, Völgyes D, Samset E, et al. Mitral annulus segmentation and anatomical orientation detection in TEE images using periodic 3D CNN. IEEE Access. 2022;10:51472–86.
Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vis. 2004;60(2):91–110.
Muja M, Lowe DG. Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP 2009. SciTePress, 2009:331–40.
Hirschmuller H. Stereo processing by semiglobal matching and mutual information. IEEE Trans Pattern Anal Mach Intell. 2008;30(2):328–41.
Arun KS, Huang TS, Blostein SD. Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell. 1987;PAMI-9(5):698–700.
Bleyer M, Chambon S. Does color really help in dense stereo matching? 3DPVT 2010. 2010:1–8.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Welz, J. et al. (2023). Matching Endoscopic 3D Image Data with 4D Echocardiographic Data for Extended Reality Support in Mitral Valve Repair Surgery. In: Deserno, T.M., Handels, H., Maier, A., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2023. BVM 2023. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-41657-7_65
Download citation
DOI: https://doi.org/10.1007/978-3-658-41657-7_65
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-41656-0
Online ISBN: 978-3-658-41657-7
eBook Packages: Computer Science and Engineering (German Language)