article

Panoramic video textures

Authors:

Aseem Agarwala,

Ke Colin Zheng,

Maneesh Agrawala,

Richard SzeliskiAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 24, Issue 3

Pages 821 - 827

https://doi.org/10.1145/1073204.1073268

Published: 01 July 2005 Publication History

Abstract

This paper describes a mostly automatic method for taking the output of a single panning video camera and creating a panoramic video texture (PVT): a video that has been stitched into a single, wide field of view and that appears to play continuously and indefinitely. The key problem in creating a PVT is that although only a portion of the scene has been imaged at any given time, the output must simultaneously portray motion throughout the scene. Like previous work in video textures, our method employs min-cut optimization to select fragments of video that can be stitched together both spatially and temporally. However, it differs from earlier work in that the optimization must take place over a much larger set of data. Thus, to create PVTs, we introduce a dynamic programming step, followed by a novel hierarchical min-cut optimization algorithm. We also use gradient-domain compositing to further smooth boundaries between video fragments. We demonstrate our results with an interactive viewer in which users can interactively pan and zoom on high-resolution PVTs.

Supplementary Material

MP4 File (pps051.mp4)

Download
29.28 MB

References

[1]

Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3, 294--302.]]

Digital Library

[2]

Bergen, J. R., Anandan, P., Hanna, K. J., and Hingorani, R. 1992. Hierarchical model-based motion estimation. In European Conference on Computer Vision, 237--252.]]

Digital Library

[3]

Brown, M., and Lowe, D. 2003. Recognising panoramas. In Proceedings of ICCV 03, 1218--1225.]]

Digital Library

[4]

Chen, S. E. 1995. Quicktime VR - an image-based approach to virtual environment navigation. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 29--38.]]

Digital Library

[5]

Finkelstein, A., Jacobs, C. E., and Salesin, D. H. 1996. Multiresolution video. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 281--290.]]

Digital Library

[6]

Fitzgibbon, A. W. 2001. Stochastic rigidity: Image registration for nowhere-static scenes. In Proceedings of ICCV 2001, 662--670.]]

[7]

Freeman, W. T., Pasztor, E. C., and Carmichael, O. T. 2000. Learning low-level vision. International Journal of Computer Vision 40, 1, 25--47.]]

Digital Library

[8]

Irani, M., and Anandan, P. 1998. Video indexing based on mosaic representation. Proceedings of IEEE 86, 5, 905--921.]]

[9]

Kimber, D., Foote, J., and Lertsithichai, S. 2001. Fly-about: spatially indexed panoramic video. In Proceedings of ACM MULTIMEDIA '01, 339--347.]]

Digital Library

[10]

Kolmogorov, V., and Zabih, R. 2002. What energy functions can be minimized via graph cuts? In European Conference on Computer Vision (ECCV), 65--81.]]

Digital Library

[11]

Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.]]

Digital Library

[12]

Nayar, S. K. 1997. Catadioptric omnidirectional camera. In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), 482.]]

Digital Library

[13]

Neumann, U., Pintaric, T., and Rizzo, A. 2000. Immersive panoramic video. In Proceedings of MULTIMEDIA '00, 493--494.]]

Digital Library

[14]

Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3, 313--318.]]

Digital Library

[15]

Point Grey Research, 2005. http://ptgrey.com.]]

[16]

Rav-Acha, A., Pritch, Y., Lischinski, D., and Peleg, S. 2005. Dynamosaics: Video mosaics with non-chronological time. In Proceedings of CVPR 2005, To appear.]]

Digital Library

[17]

Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proceedings of SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 489--498.]]

Digital Library

[18]

Szeliski, R., and Shum, H.-Y. 1997. Creating full view panoramic mosaics and environment maps. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 251--258.]]

Digital Library

[19]

Triggs, B., Mclauchlan, P. F., Hartley, R. I., and Fitzgibbon, A. W. 2000. Bundle adjustment - a modern synthesis. In ICCV '99: Proceedings of the International Workshop on Vision Algorithms, Springer-Verlag, 298--372.]]

Digital Library

[20]

Uyttendaele, M., Criminisi, A., Kang, S. B., Winder, S. A. J., Hartley, R., and Szeliski, R. 2004. High-quality image-based interactive exploration of real-world environments. IEEE Computer Graphics and Applications 24, 3, 52--63.]]

Digital Library

[21]

Wang, H., Raskar, R., and Ahuja, N. 2004. Seamless video editing. In Proceedings of the International Conference on Pattern Recognition (ICPR), 858--861.]]

Digital Library

Cited By

Bertiche HMitra NKulkarni KHuang CWang TMadadi MEscalera SCeylan D(2023)Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00052(459-468)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00052
Ma LLi XLiao JSander P(2023)3D Video Loops from Asynchronous Input2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00038(310-320)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00038
Zhou YYang JLi DSaito JAneja DKalogerakis E(2022)Audio-driven Neural Gesture Reenactment with Video Motion Graphs2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.00341(3408-3418)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.00341
Show More Cited By

Index Terms

Panoramic video textures
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Video summarization
  2. Computer graphics
    1. Image manipulation
      1. Texturing
2. Theory of computation
  1. Design and analysis of algorithms
    1. Algorithm design techniques
      1. Dynamic programming

Recommendations

Video textures
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...
Panoramic video textures
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

This paper describes a mostly automatic method for taking the output of a single panning video camera and creating a panoramic video texture (PVT): a video that has been stitched into a single, wide field of view and that appears to play continuously ...
Panoramic stereo video textures
ICCV '11: Proceedings of the 2011 International Conference on Computer Vision

A panoramic stereo (or omnistereo) pair of images provides depth information from stereo up to 360 degrees around a central observer. Because omnistereo lenses or mirrors do not yet exist, synthesizing omnistereo images requires multiple stereo camera ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 24, Issue 3

July 2005

826 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1073204

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Published in TOG Volume 24, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

117
Total Citations
View Citations
1,941
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bertiche HMitra NKulkarni KHuang CWang TMadadi MEscalera SCeylan D(2023)Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00052(459-468)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00052
Ma LLi XLiao JSander P(2023)3D Video Loops from Asynchronous Input2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00038(310-320)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00038
Zhou YYang JLi DSaito JAneja DKalogerakis E(2022)Audio-driven Neural Gesture Reenactment with Video Motion Graphs2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.00341(3408-3418)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.00341
Halperin THakim HVantzos OHochman GBenaim NSassy LKupchik MBibi OFried O(2021)Endless loopsACM Transactions on Graphics10.1145/3450626.345993540:4(1-12)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459935
Can YErsoy C(2021)Privacy-preserving Federated Deep Learning for Wearable IoT-based Biomedical MonitoringACM Transactions on Internet Technology10.1145/342815221:1(1-17)Online publication date: 5-Jan-2021
https://dl.acm.org/doi/10.1145/3428152
Thonat TAksoy YAittala MParis SDurand FDrettakis G(2021)Video‐Based Rendering of Dynamic Stationary Environments from Unsynchronized InputsComputer Graphics Forum10.1111/cgf.1434240:4(73-86)Online publication date: 15-Jul-2021
https://doi.org/10.1111/cgf.14342
Wehrwein SBala KSnavely N(2021)Scene Summarization via Motion NormalizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.299319527:4(2495-2501)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TVCG.2020.2993195
Yi HZhu ZGu Y(2021)Dynamic Texture Feature Extraction Based on multi-scale Convolutional Autoencoder2021 4th International Conference on Intelligent Autonomous Systems (ICoIAS)10.1109/ICoIAS53694.2021.00027(108-112)Online publication date: May-2021
https://doi.org/10.1109/ICoIAS53694.2021.00027
Holynski ACurless BSeitz SSzeliski R(2021)Animating Pictures with Eulerian Motion Fields2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.00575(5806-5815)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.00575
Jenni SFavaro P(2021)Self-supervised Multi-view Synchronization Learning for 3D Pose EstimationComputer Vision – ACCV 202010.1007/978-3-030-69541-5_11(170-187)Online publication date: 26-Feb-2021
https://doi.org/10.1007/978-3-030-69541-5_11
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents