Abstract
In robot-assisted laparoscopic surgery, an endoscopic camera is used to control the motion of surgical instruments. With this minimally invasive surgical (MIS) technique, every instrument has to pass through an insertion point in the abdominal wall and is mounted on the end-effector of a surgical robot which can be controlled by visual feedback. To achieve an accurate vision-based positioning of laparoscopic instruments, we introduce the motion constraint in MIS which is based on the location of out-of-field of view insertion points. The knowledge of the (image of the) insertion point location is helpful for real-time image segmentation issues, particularly to initiate the search for region seeds corresponding to the instruments. Moreover, with this ”eye-to-hand” robot vision system, visual servoing is a very convenient technique to automatically guide an instrument but it requires the velocity screw to be expressed in the appropriate frame. Then, the location of the insertion point is seen as the main part of the larger problem of determining the overall transformation between the camera and the robot end-effector frame. This is achieved thanks to a novel algorithm for the pose determination of cylindrical-shaped instruments. With the proposed method, the location of insertion points can be recovered, on-line, with no marker, without any knowledge of robot kinematics and without an external measurement device.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Funda, J., Taylor, R., Eldridge, B., Gomory, S., Gruben, K.: Constrained cartesian motion control for teleoperated surgical robots. IEEE Trans. on Robotics and Automation 12 (1996)
Hutchinson, S., Hager, G.D., Corke, P.: A tutorial on visual servo control. IEEE Trans. on Robotics and Automation 12, 651–670 (1996)
Espiau, B., Chaumette, F., Rives, P.: A new approach to visual servoing in robotics. IEEE Transactions on Robotics and Automation 8, 313–326 (1992)
Wei, G.Q., Arbter, K., Hirzinger, G.: Real-time visual servoing for laparoscopic surgery. IEEE Engineering in Medicine and Biology 16, 40–45 (1997)
Wang, Y.F., Uecker, D.R., Wang, Y.: A new framework for vision-enabled and robotically assisted minimally invasive surgery. Journal of Computerized Medical Imaging and Graphics 22, 429–437 (1998)
Hayashibe, M., Nakamura, Y.: Laser-pointing endoscope system for intra-operative geometric registration. In: Proc. of ICRA 2001, Seoul, South Korea (2001)
Krupa, A., Gangloff, J., Doignon, C., de Mathelin, M., Morel, G., Leroy, J., Soler, L., Marescaux, J.: Autonomous 3-d positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. IEEE Trans. on Robotics and Automation 10, 842–853 (2003)
Burschka, D., Corso, J.J., Dewan, M., Hager, G.D., Lau, W., Li, M., Lin, H., Marayong, P., Ramey, N.: Navigating inner space: 3-D assistance for minimally invasive surgery. In: Workshop Advances in Robot Vision, IEEE/RSJ Int’l. Conf. on Intelligent Robots and Systems, Sendai, Japan, pp. 67–78 (2004)
Ortmaier, T., Hirzinger, G.: Cartesian control issues for minimally invasive robot surgery. In: Proceedings of IROS 2000, Takamatsu, Japan (2000)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge Univ. Press, Cambridge (2000)
Doignon, C., Graebling, P., de Mathelin, M.: Real-time segmentation of surgical instruments inside the abdominal cavity using a joint hue saturation color feature. Real-Time Imaging 11, 429–442 (2005)
Wong, K.Y., Mendonça, P.R.S., Cipolla, R.: Reconstruction of surfaces of revolution from single uncalibrated views. Image and Vis. Computing 22, 829–836 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Doignon, C., Nageotte, F., de Mathelin, M. (2006). The Role of Insertion Points in the Detection and Positioning of Instruments in Laparoscopy for Robotic Tasks. In: Larsen, R., Nielsen, M., Sporring, J. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2006. MICCAI 2006. Lecture Notes in Computer Science, vol 4190. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11866565_65
Download citation
DOI: https://doi.org/10.1007/11866565_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44707-8
Online ISBN: 978-3-540-44708-5
eBook Packages: Computer ScienceComputer Science (R0)