Abstract
In this paper, we will introduce a common framework for the definition and operations on the different multiple view tensors. The novelty of the proposed formulation is to not fix any parameters of the camera matrices, but instead letting a group act on them and look at the different orbits. In this setting the multiple view geometry can be viewed as a four-dimensional linear manifold in IR3 m, where m denotes the number of images. The Grassman coordinates of this manifold are the epipoles, the components of the fundamental matrices, the components of the trifocal tensor and the components of the quadfocal tensor. All relations between these Grassman coordinates can be expressed using the so called quadratic p-relations, which are quadratic polynomials in the Grassman coordinates. Using this formulation it is evident that the multiple view geometry is described by four different kinds of projective invariants; the epipoles, the fundamental matrices, the trifocal tensors and the quadfocal tensors.
As an application of this formalism it will be shown how the multiple view geometry can be calculated from the fundamental matrix for two views, from the trifocal tensor for three views and from the quadfocal tensor for four views. As a byproduct, we show how to calculate the fundamental matrices from a trifocal tensor, as well as how to calculate the trifocal tensors from a quadfocal tensor. It is, furthermore, shown that, in general, n < 6 corresponding points in four images gives 16n − n(n − 1)/2 linearly independent constraints on the quadfocal tensor and that 6 corresponding points can be used to estimate the tensor components linearly. Finally, it is shown that the rank of the trifocal tensor is 4 and that the rank of the quadfocal tensor is 9.
This work has been done within then ESPRIT Reactive LTR project 21914, CUMULI and the Swedish Research Council for Engineering Sciences (TFR), project 95-64-222
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
O. Faugeras and B. Mourrain. About the correspondence of points between n images. In IEEE Workshop on Representation of Visual Scenes, MIT, Boston, MA, pages 37–44. IEEE Computer Society Press, 1995.
O. Paugeras and B. Mourrain. On the geometry and algebra of the point and line correspondences between n images. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, pages 951–956. IEEE Computer Society Press, 1995.
O. Faugeras and T. Papadopoulo. Grassman-cayley algebra for modeling systems of cameras and the algebraic equations of the manifold of trifocal tensors. Technical Report 3225, Institut national de rechereche en informatique et en automatique, july 1997.
O. Faugeras and T. Papadopoulo. A nonlinear method for estimating the projective geometry of three views. In Proc. 6th Int. Conf. on Computer Vision, Mumbai, India, 1998. to appear.
B. Gelbaum. Linear Algebra: Basic, Practice and Theory. North-Holand, 1989.
R. Hartley. A linear method for reconstruction from points and lines. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, pages 882–887. IEEE Computer Society Press, 1995.
R. Hartley. Lines and points in three views and the trifocal tensor. Int. Journal of Computer Vision, 22(2):125–140, March 1997.
A. Heyden. Reconstruction from image sequences by means of relative depths. Int. Journal of Computer Vision, 24(2):155–161, September 1997. also in Proc. of the 5th International Conference on Computer Vision, IEEE Computer Society Press, pp. 1058–1063.
A. Heyden and K. åström. Algebraic varieties in multiple view geometry. In B. Buxton and R. Cipolla, editors, Proc. 4th European Conf. on Computer Vision, Cambridge, UK, volume 1065 of Lecture notes in Computer Science, pages 671–682. Springer-Verlag, 1996.
A. Heyden and K. åström. Algebraic properties of multilinear constraints. Mathematical Methods in the Applied Scinces, 20:1135–1162, 1997.
W. V. D. Hodge and D. Pedoe. Methods of Algebraic Geometry. Cambridge University Press, 1947.
Q.-T. Luong and T. Vieville. Canonic representations for the geometries of multiple projective views. In J.-O. Eklund, editor, Proc. 4th European Conf. on Computer Vision, Cambridge, UK, volume 800 of Lecture Notes in Computer Science, pages 589–599. Springer-Verlag, 1994.
A. Shashua. Trilinearity in visual recognition by alignment. In J.-O. Eklund, editor, Proc. 4th European Conf. on Computer Vision, Cambridge, UK, volume 800 of Lecture Notes in Computer Science, pages 479–484. Springer-Verlag, 1994.
A. Shashua and S. Maybank. Degenerate n point configurations of three views: Do critical surfaces exist? Technical Report TR 96-19, Hebrew University of Jerusalem, 1996.
A. Shashua and M. Werman. On the trilinear tensor of three perspective views and its associated tensor. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, pages 920–925. IEEE Computer Society Press, 1995.
M. E. Spetsakis and J. Aloimonos. A unified theory of structure from motion. In Proc. DARPA IU Workshop, pages 271–283, 1990.
B. Triggs. Matching constraints and the joint image. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, pages 338–343. IEEE Computer Society Press, 1995.
A. Zisserman. A users guide to the trifocal tensor. Draft, july 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heyden, A. (1998). A common framework for multiple view tensors. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV'98. ECCV 1998. Lecture Notes in Computer Science, vol 1406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055656
Download citation
DOI: https://doi.org/10.1007/BFb0055656
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64569-6
Online ISBN: 978-3-540-69354-3
eBook Packages: Springer Book Archive