Article

Free access

Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery

Authors:

Aditi Majumder,

W. Brent Seales,

M. Gopi,

Henry FuchsAuthors Info & Claims

MULTIMEDIA '99: Proceedings of the seventh ACM international conference on Multimedia (Part 1)

Pages 169 - 178

https://doi.org/10.1145/319463.319485

Published: 30 October 1999 Publication History

PDF eReader

Abstract

This paper presents a new algorithm for immersive teleconferencing, which addresses the problem of registering and blending multiple images together to create a single seamless panorama. In the immersive teleconference paradigm, one frame of the teleconference is a panorama that is constructed from a compound-image sensing device. These frames are rendered at the remote site on a projection surface that surrounds the user, creating an immersive feeling of presence and participation in the teleconference. Our algorithm efficiently creates panoramic frames for a teleconference session that are both geometrically registered and intensity blended. We demonstrate a prototype that is able to capture images from a compound-image sensor, register them into a seamless panoramic frame, and render those panoramic frames on a projection surface at 30 frames per second.

References

[1]

Ft. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, H. Fuchs, "The Office of the Future : A Unified Approach to Image-Based Modeling and Spatially Immersive Displays," SIGGRAPH, pp. 179-188, 1998.

Digital Library

Google Scholar

[2]

Ft. Szeliski, H. Shum, "Creating Full View Panoramic Mosaics and Environment Maps," ${GGRAPH, pp. 251-258, 1997.

Digital Library

Google Scholar

[3]

Sanjib K. Ghosh, Analytical Photogrammetry, second edition, Pergamon, 1988.

Google Scholar

[4]

It. Hartley, G. Gupta, "Linear Pushbroom Cameras," In J. Eklundh, editor, Third European Conf. on Computer Vision, pp. 555-566, Stockholm, Sweden,May 1994.

Digital Library

Google Scholar

[5]

S. Peleg, J. Herman "Panoramic Mosaics by Manifold Projection,'' In Proceedings o} CVPR, pp. 338-343, June 1997.

Digital Library

Google Scholar

[6]

S. Baker, S. Nayar, "A Theory of Catadioptric Image Formation,'' In Proceedings of CVPR, pp. 35-42, June 1997.

Digital Library

Google Scholar

[7]

S. Nayar, "Catadioptric omnidirectionalcamera," In Proceedings of CVPR, pp. 482-488, June 1997.

Digital Library

Google Scholar

[8]

V. Nalwa, "A true omnidirectional viewer," Tech Report Bell Laboratories, Holmdel NJ 07733 USA Feb 1996.

Google Scholar

[9]

S.E.Chen, "QuickTime VR- An Image Based Approach to Virtual Environment Navigation," SIGGRAPH, pp. 29-38, 1995.

Digital Library

Google Scholar

[10]

O. D. Faugeras, Three-Dimensional Computer Vision: A Geometric Approach, first edition, MIT Press, 1993.

Digital Library

Google Scholar

[11]

R. Tsai, "A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the- Shelf TV Cameras and Lenses," IEEE Journal oat Robotics and Automation, 3(4) pp. 323-344, 1987.

Crossref

Google Scholar

[12]

P.J.Burt, E.H.Adelson, A Multiresolution Spline With Application to Image Mosaics, ACM Transaction on Graphics, Vol. 2, No. 4, Oct 1983, pp 217-236.

Digital Library

Google Scholar

[13]

T.Kawanishi, K.Yamazawa, H.Iwasa, H.Takemura, N.Yokoya, "Generation of high resolution stereo panoramic images by omnidirectional sensor using hexagonal pyramidal mirrors", ICPR '98, pp 485-489.

Digital Library

Google Scholar

Cited By

View all

Lawrence JGoldman DAchar SBlascovich GDesloge JFortes TGomez EHäberling SHoppe HHuibers AKnaus CKuschak BMartin-Brualla RNover HRussell ASeitz STong K(2021)Project starlineACM Transactions on Graphics10.1145/3478513.348049040:6(1-16)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480490
Wu SBlair kXu JZhu SGuo HWang KChen L(2017)Real Time Video Stitching by Exploring Temporal and Spatial FeaturesProceedings of the 10th EAI International Conference on Mobile Multimedia Communications10.4108/eai.13-7-2017.2270086(228-233)Online publication date: 8-Dec-2017
https://dl.acm.org/doi/10.4108/eai.13-7-2017.2270086
Zhu LWang WLiu YLai SLi J(2017)A video stitching system based on mirror pyramids and non-overlapping calibration method2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)10.1109/CISP-BMEI.2017.8301925(1-6)Online publication date: Oct-2017
https://doi.org/10.1109/CISP-BMEI.2017.8301925
Show More Cited By

Index Terms

Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery

Recommendations

Real World Teleconferencing

We've been exploring how augmented reality (AR) technology can create fundamentally new forms of remote collaboration for mobile devices. AR involves the overlay of virtual graphics and audio on reality. Typically, the user views the world through a ...
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality Conference

In this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Immersive Video Teleconferencing with User-Steerable Views

Existing video teleconferencing techniques suffer from limited field of view, low resolution, and fixed viewpoint. We present a set of novel techniques to overcome these limitations. Based on the light field rendering concept, we utilize an array of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MULTIMEDIA '99: Proceedings of the seventh ACM international conference on Multimedia (Part 1)

October 1999

516 pages

ISBN:1581131518

DOI:10.1145/319463

Chairmen:
John Buford
GTE Laboratories
,
Scott Stevens
Carnegie Mellon Univ.
,
Dick Bulterman
CWI
,
Kevin Jeffay
Univ. of North Carolina, Chapel Hill
,
HongJiang Zhang
Microsoft Research, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

MM99

Sponsor:

MM99: ACM Multimedia 1999

October 30 - November 5, 1999

Florida, Orlando, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
599
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)8

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lawrence JGoldman DAchar SBlascovich GDesloge JFortes TGomez EHäberling SHoppe HHuibers AKnaus CKuschak BMartin-Brualla RNover HRussell ASeitz STong K(2021)Project starlineACM Transactions on Graphics10.1145/3478513.348049040:6(1-16)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480490
Wu SBlair kXu JZhu SGuo HWang KChen L(2017)Real Time Video Stitching by Exploring Temporal and Spatial FeaturesProceedings of the 10th EAI International Conference on Mobile Multimedia Communications10.4108/eai.13-7-2017.2270086(228-233)Online publication date: 8-Dec-2017
https://dl.acm.org/doi/10.4108/eai.13-7-2017.2270086
Zhu LWang WLiu YLai SLi J(2017)A video stitching system based on mirror pyramids and non-overlapping calibration method2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)10.1109/CISP-BMEI.2017.8301925(1-6)Online publication date: Oct-2017
https://doi.org/10.1109/CISP-BMEI.2017.8301925
Popovic VSeyid KCogal ÖAkin ALeblebici YPopovic VSeyid KCogal ÖAkin ALeblebici Y(2017)State-of-the-Art Multi-Camera SystemsDesign and Implementation of Real-Time Multi-Sensor Vision Systems10.1007/978-3-319-59057-8_2(13-31)Online publication date: 5-Jul-2017
https://doi.org/10.1007/978-3-319-59057-8_2
Macekova LPalahin VHandrikova JMarchevsky S(2016)Applying of video technologies in educational process2016 26th International Conference Radioelektronika (RADIOELEKTRONIKA)10.1109/RADIOELEK.2016.7477384(367-371)Online publication date: Apr-2016
https://doi.org/10.1109/RADIOELEK.2016.7477384
Ibrahim MHafiz RKhan MCho Y(2016)Automatic selection of color reference image for panoramic stitchingMultimedia Systems10.1007/s00530-015-0467-422:3(379-392)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s00530-015-0467-4
Saeed SHafiz RRasul AKhan MCho YPark UCha J(2015)A unified panoramic stitching and multi-projector rendering scheme for immersive panoramic displaysDisplays10.1016/j.displa.2015.06.00240(78-87)Online publication date: Dec-2015
https://doi.org/10.1016/j.displa.2015.06.002
Pece FTompkin JPfister HKautz JTheobalt CHall PCollomosse JCosker D(2014)Device effect on panoramic video+context tasksProceedings of the 11th European Conference on Visual Media Production10.1145/2668904.2668943(1-9)Online publication date: 13-Nov-2014
https://dl.acm.org/doi/10.1145/2668904.2668943
Xu YZhou QGong LZhu MDing XTeng R(2014)High-Speed Simultaneous Image Distortion Correction Transformations for a Multicamera Cylindrical Panorama Real-time Video System Using FPGAIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2013.229057624:6(1061-1069)Online publication date: Jun-2014
https://doi.org/10.1109/TCSVT.2013.2290576
Pece FSteptoe WWanner FJulier SWeyrich TKautz JSteed AMackay WBrewster SBødker S(2013)PanoinsertsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2466173(1319-1328)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2466173
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Real World Teleconferencing

Mixed reality in virtual world teleconferencing

Immersive Video Teleconferencing with User-Steerable Views