article

COMVIS: A Communication Framework for Computer Vision

Authors:

Florentin WörgötterAuthors Info & Claims

International Journal of Computer Vision, Volume 41, Issue 3

Pages 183 - 194

https://doi.org/10.1023/A:1011156004656

Published: 01 February 2001 Publication History

Abstract

We describe a general approach to integrate the information produced by different visual modules with the goal of generating a quantitative 3D reconstruction of the observed scene and to estimate the reconstruction errors.

The integration is achieved in two steps. Firstly, several different visual modules analyze the scene in terms of a common data representation: planar patches are used by different visual modules to communicate and represent the 3D structure of the scene. We show how it is possible to use this simple data structure to share and integrate information from different visual modalities, and how it can support the necessities of the great majority of different visual modules known in literature. Secondly, we devise a communication scheme able to merge and improve the description of the scene in terms of planar patches. The applications of state-of-the-art algorithms allows to fuse information affected by an unknown grade of correlation and still guarantee conservative error estimates.

Tests on real and synthetic scene show that our system produces a consistent and marked improvement over the results of single visual modules, with error reduction up to a factor of ten and with typical reduction of a factor 2–4.

References

[1]

Aloimonos, J. and Shulman, D. 1989. Integration of Visual Modules--An Extension of the Marr Paradigm. Academic Press: London.]]

Digital Library

[2]

Calibrated Imaging Laboratory home page. http://www.cs.cmu.edu/ ~cil/cil-ster.html]]

[3]

Cozzi, A., Crespi, B., Valentinotti, F., and Wörgötter, F. 1997. Performance of phase-based algorithms for disparity estimation. Machine Vision and Applications, 9(5-6):334-340.]]

Digital Library

[4]

Eckhorn, R., Bauer, R., Jordan, W., Kruse, B.M.W., Munk, M., and Reitböck, H. 1988. Coherent oscillations: A mechanism of feature linking in the visual cortex? Biological Cybernetics, 60:121-130.]]

Digital Library

[5]

Faugeras, O. 1993. Three-Dimensional Computer Vision. MIT Press: Cambridge.]]

Digital Library

[6]

Fleet, D., Jepson, A., and Jenkin, M. 1991. Phase-based disparity measurement. Computer Vision, Graphic and Image Processing, 53(2):198-210.]]

Digital Library

[7]

Fua, P., Leclerc, Y., and Loung 1999. Characterizing the performance of multiple-image point-correspondence algorithms using self-consistency. In Proceedings of: The Vision Algorithms: Theory and Practice Workshop (ICCV99), Corfu, Greece.]]

Digital Library

[8]

Fua, P. and Leclerc, Y.G. 1995. Object-centered surface reconstruction: Combining multi-image stereo and shading. IJCV, 16:35- 56.]]

Digital Library

[9]

Gamble, E. and Poggio, T. 1987. Visual integration and detection of discontinuities: The key role of intensity edges. A.I. Memo 970, MIT, Artificial Intelligent Laboratory.]]

Digital Library

[10]

Geman, S. and Geman, D. 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Intelligence, 6(6):721-741.]]

Digital Library

[11]

Haralick, R.M. 1996. Propagating covariance in computer vision. In Workshop on Performance Characteristics of Vision Algorithms, H.I. Christensen, W. Förstner, and C.B. Madsen (Eds.), Cambridge, UK, pp. 1-12. http://www.vision.auc.dk/~hic/ performance-ws.html]]

[12]

Irani, M. and Anandan, P. 1996. Parallax geometry of pairs of points for 3d scene analysis. In Proc. 4th European Conf. on Computer Vision, Cambridge, Cambridge, UK, Vol. 1, pp. 17-30.]]

Digital Library

[13]

Kanatani, K. 1990. Group-Theoretical Methods in Image Understanding , volume 20 of Springer Series in information Sciences. Springer-Verlag: Berlin, Heidelberg.]]

Digital Library

[14]

Lucas, B. and Kanade, T. 1984. Optical navigation by the method of differences. In DARPA84, pp. 272-281.]]

[15]

Maybeck, P.S. 1979. Stochastic Models, Estimation, and Control, vol. 1 of Mathematics in Science and Engineering. Academic Press: New York.]]

[16]

Opara, R. and Wörgötter, F. 1998. A fast and robust cluster update algorithm for image segmentation in spin-lattice models without annealing--visual latencies revisited. Neural Computation, 10:1547-1566.]]

Digital Library

[17]

Pankanti, S. and Jain, A.K. 1995. A uniform bayesian framework for integration. Technical Report, Michigan State University.]]

[18]

Poggio, T.A., Gamble, E., and Little. J.J. 1988. Parallel integration of vision modules. Science, 242:436-439.]]

[19]

Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C. Cambridge University Press, second edn.]]

[20]

Singer, W. and Gray, C.M. 1995. Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci., 18:555- 586.]]

[21]

Uhlmann, J.K. 1997. A culminating advance in the theory and practice of data fusion, filtering, and decentralized estimation. Technical report. Covariance Intersection Working Group.http://www.ait.nrl.navy.mil/people/uhlmann/covlnt.html.]]

[22]

Wang, D. and Terman, D. 1997. Image segmentation based on oscilatory correlation. Neural Computation, 9:1623-1626.]]

Digital Library

Cited By

Du YMa CTeng DDai GDai GZhang KHuang MWang HYuan XTao LChen W(2010)Cooperative concept map based on cognitive model for visual analysisProceedings of the 3rd International Symposium on Visual Information Communication10.1145/1865841.1865861(1-8)Online publication date: 28-Sep-2010
https://dl.acm.org/doi/10.1145/1865841.1865861
Krüger NJäger TPerwass C(2002)Extraction of Object Representations from Stereo Image Sequences Utilizing Statistical and Deterministic Regularities in Visual DataProceedings of the Second International Workshop on Biologically Motivated Computer Vision10.5555/648248.751720(322-330)Online publication date: 22-Nov-2002
https://dl.acm.org/doi/10.5555/648248.751720

Index Terms

COMVIS: A Communication Framework for Computer Vision
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction

Recommendations

Visual tracking by fusing multiple cues with context-sensitive reliabilities

Many researchers argue that fusing multiple cues increases the reliability and robustness of visual tracking. However, how the multi-cue integration is realized during tracking is still an open issue. In this work, we present a novel data fusion ...
Co-saliency Detection with Graph Matching
Survey Paper, Research Commentary and Regular Papers

Recently, co-saliency detection, which aims to automatically discover common and salient objects appeared in several relevant images, has attracted increased interest in the computer vision community. In this article, we present a novel graph-matching ...
RETRACTED ARTICLE: Multimedia and multi-feature cluster fusion model based on saliency for mobile network applications
Abstract
This paper introduces the concept, advantages, structure, method and application of multisensor integration and data fusion, and lists four different integration characteristics of sensors. Data fusion technology combines data from different ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of Computer Vision

International Journal of Computer Vision Volume 41, Issue 3

February/March 2001

74 pages

ISSN:0920-5691

Issue’s Table of Contents

Copyright © Copyright © 2001 Kluwer Academic Publishers.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 February 2001

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Du YMa CTeng DDai GDai GZhang KHuang MWang HYuan XTao LChen W(2010)Cooperative concept map based on cognitive model for visual analysisProceedings of the 3rd International Symposium on Visual Information Communication10.1145/1865841.1865861(1-8)Online publication date: 28-Sep-2010
https://dl.acm.org/doi/10.1145/1865841.1865861
Krüger NJäger TPerwass C(2002)Extraction of Object Representations from Stereo Image Sequences Utilizing Statistical and Deterministic Regularities in Visual DataProceedings of the Second International Workshop on Biologically Motivated Computer Vision10.5555/648248.751720(322-330)Online publication date: 22-Nov-2002
https://dl.acm.org/doi/10.5555/648248.751720

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents