Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1007/11736639_143guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Multi-user live video in a shared virtual world for enhanced group collaboration

Published: 16 April 2006 Publication History

Abstract

We present a novel method for merging a live video stream of multiple users into a shared virtual world in a large VR display environment. Collaborators at a remote site can be displayed in a virtual world as video textures to support visual communication more efficiently. To generate the video texture of a user in a dynamic background environment such as a CAVETM-like system, we use a camera pair which consists of two gray-scale cameras with band-pass filters, and two color cameras. The gray-scale cameras capture infrared images in which the dynamic background on the screen is eliminated, having only the infrared light reflected by the person. This makes it easy to extract the user's silhouette robustly. Using projection histogram we found rough position of the all users' head in the image. We can then find exact corresponding points using cross-correlation between two user silhouette images to determine the 3D position of each user. The extracted user silhouette is warped by rectification and translated to fit into a color image. We can now generate a video texture of the user by masking the background of the user in the color image. Each video texture is then transmitted to a remote site and displayed on a billboard in virtual space.

References

[1]
T. Ogi, T. Yamada, K. Tamagawa, M. Kano, and M. Hirose. Immersive telecommunication using stereo video avatar. In Proc. Virtual Reality 2001 Conference (VR01). IEEE Computer Society Press, 2001.
[2]
T. Ogi, T. Yamada, M. Hirose, M. Fujita, and K. Kuzuu. High presence remote presentation in the shared immersive virtual world. In Proc. IEEE Virtual Reality 2003 Conference (VR03). IEEE Computer Society Press, 2003.
[3]
T. Ogi, T. Yamada, Y. Hattori Y. Kurita, and M. Hirose. Usage of video avatar technology for immersive communication. In Proc. First Intl Workshop on Language Understanding and Agents for Real World Interaction 2003, 2003.
[4]
M. Gross, S. Wuermlin, M. Naef, E. Lamboray, C. Spagno, A. Kunz, E. K-Meier, T. Svoboda, L. Gool, S. Lang, K. Strehlke, A. V. Moere, and O. Staadt. blue-c: a spatially immersive display and 3d video portal for telepresence. ACM Trans. Graphics, 22(3):819-827, 2003.
[5]
S. Wuemlin, E. Lamboray, and M. Gross. 3d video fragments: Dynamic point samples for real-time free-viewpoint video. Computers and Graphics, 28(1):3-14, 2004.
[6]
A. Vorozcovs, A. Hogue, and W. Stuerzlinger. The hedgehog: a novel optical tracking method for spatially immersive displays. In Proc. IEEE VR 2005. IEEE Computer Society press, 2005.
[7]
W. Matusik. Image-based visual hulls. Master's thesis, Massachusetts Institute of Technology, 2001.
[8]
I. Haritaoglu, D. Harwood, and L.S. Davis. Hydra: Multiple people detection and tracking using silhouettes. In Proc.IEEE International Workshop on Visual Surveillance. IEEE Computer Society press, 1999.
[9]
R. Y. Tsai. An efficient and accurate camera calibration technique for 3d machine vision. In Proc. IEEE Computer Vision and Pattern Recognition. IEEE Computer Society Press, 1986.
[10]
A. Fusiello, E. Trucco, and A. Verri. A compact algorithm for rectification of stereo pairs. Machin Vision and Applications, 12(1):16-22, 2000.
[11]
M. Naef, O. Staadt, and M. Gross. Multimedia integration into the blue-c api. Computers and Graphics, 29(1):3-15, 2005.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
Edutainment'06: Proceedings of the First international conference on Technologies for E-Learning and Digital Entertainment
April 2006
1389 pages
ISBN:3540334238
  • Editors:
  • Zhigeng Pan,
  • Ruth Aylett,
  • Holger Diener,
  • Xiaogang Jin,
  • Stefan Göbel

Sponsors

  • VT Committee of the China Society of Image and Graphics
  • Zhejiang University: Zhejiang University

In-Cooperation

  • Hangzhou National Animation Base, Zhejiang Province, China: Hangzhou National Animation Base, Zhejiang Province, China

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 16 April 2006

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Dec 2024

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media