Abstract
In post-production, a traditional method for creating some special effects is named “rotoscopy”. This technique consists of segmenting a video sequence by hand and for every frame. Our method is a new tool designed to reduce considerably the cost of this operation by making it almost automatic and quick. In our case, we track a rigid object whose geometry is known, in a sequence of video images. This new approach is based upon a two-steps process: first, one or several “keyframes” are used in a preliminary interactive calibration session, so that a 3D model of this object is positioned correctly on these images (its projection fits to the object in the image). We use this match to texture the 3D model with its image data. Then, a 3D predictor gives a position of the object model in the next image and the fine tuning of this position is obtained by simply minimizing the error between the textured model in this position and the real image of the object. Minimization is performed with respect to the 6 DOF (Degrees of Freedom) of the model position (3 translation parameters and 3 rotation ones). This procedure is iterated at each frame. Test sequences show how robust the method is.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
R. Basri and D.W. Jacobs. Recognition using region correspondences. International Journal of Computer Vision, 25(2): 145–166, 1997.
R. N. Braithwaite and B. Bhanu. Hierarchical Gabor filters for object detection in infrared images. In CVPR, pages 628–631, 1994.
P. Coiffet. La Robotique, principes et applications, pages 189–190. Editions Hermes, 1986.
F. Dellaert, D. Pomerleau, and C. Thorpe. Model-based car tracking integrated with a road-follower. In International Conference on Robotics and Automation, Leuven, Belgium, May 16–20, 1998.
F. Dellaert, C. Thorpe, and S. Thrun. Super-resolved texture tracking of planar surface patches. In IEEE/RSJ International Conference on Intelligent Robotic Systems, Victoria, October 13–17, 1998.
F. Dellaert, S. Thrun, and C. Thorpe. Jacobian images of super-resolved texture maps for model-based motion estimation and tracking. IEEE Workshop on Applications of Computer Vision (WACV’98), Princeton, New Jersey, October 19–21, pages 2–7, 1998.
D. M. Gavrila and L. S. Davis. 3D model-based tracking of humans in action: A multiview approach. IEEE Intl. Symp. On Computer Vision, Coral Gables, FL, pages 253–258, 1995.
D. S. Jang, K. Gye-Young, and K. H. Choi. Model-based tracking of moving object. Pattern Recognition, 30(6):999–1008, 1997.
T. Jebara, K. Russell, and A. Pentland. Mixtures of eigenfeatures for real-time structure from texture. In Proceedings ICCV, pages 128–135, 1998.
D. Koller, K. Daniilidis, and H. H. Nagel. Model-based object tracking in monocular image sequences of road traffic scenes. International Journal of Computer Vision, 10(3):257–281, 1993.
H. Kollnig and H. H. Nagel. 3D pose estimation by fitting image gradients directly to polyhedral models. In ICCV’95, pages 569–574, 1995.
R. Mehrotra, K. R. Namuduri, and N. Ranganathan. Gabor filter-based edge detection. Pattern Recognition, 25(12):1479–1494, 1992.
S. Moezzi, L. Tai, and P. Gerard. Virtual view generation for 3D digital video. IEEE Multimedia, 4(l):18–26, 1997.
W. H. Press, S. A. Teukolsky, and W. T. Vetterling. Numerical Recipes in C, the Art of Scientific Computing. Second edition, Cambridge University Press, 1992.
P. Raveda, J. Serrat, and E. Marti. A snake for model-based segmentation. In ICCV95, pages 816–821, 1995.
T. N. Tan, G. D. Sullivan, and K. D. Baker. Pose determination and recognition of vehicles in traffic scenes. In ECCV’94, volume 800, pages 501–506, 1994.
J. P. Tarel and J. M. Vezien. Camcal v1.0 manual, a complete software solution for camera calibration. Rapport de recherche, INRIA, 1996.
X. Wu and B. Bhanu. Gabor wavelets for 3-D object recognition. In ICCV’95, pages 537–542, 1995.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Gagalowicz, A., Gérard, P. (2000). 3D Object Tracking Using Analysis/Synthesis Techniques. In: Leonardis, A., Solina, F., Bajcsy, R. (eds) Confluence of Computer Vision and Computer Graphics. NATO Science Series, vol 84. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4321-9_17
Download citation
DOI: https://doi.org/10.1007/978-94-011-4321-9_17
Publisher Name: Springer, Dordrecht
Print ISBN: 978-0-7923-6612-6
Online ISBN: 978-94-011-4321-9
eBook Packages: Springer Book Archive