Article

Free access

Video textures

Authors:

Richard Szeliski,

David H. Salesin,

Irfan EssaAuthors Info & Claims

SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

Pages 489 - 498

https://doi.org/10.1145/344779.345012

Published: 01 July 2000 Publication History

Abstract

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a video texture may be repeated from time to time, the video sequence as a whole is never repeated exactly. Video textures can be used in place of digital photos to infuse a static image with dynamic qualities and explicit actions. We present techniques for analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length. We combine video textures with view morphing techniques to obtain 3D video textures. We also introduce video-based animation, in which the synthesis of video textures can be guided by a user through high-level interactive controls. Applications of video textures and their extensions include the display of dynamic scenes on web pages, the creation of dynamic backdrops for special effects and games, and the interactive control of video-based animation.

References

[1]

Z. Bar-Joseph. Statistical learning of multi-dimensional textures. Master's thesis, The Hebrew University of Jerusalem, June 1999.

[2]

D. Beymer. Feature correspondence by interleaving shape and texture computations. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), pages 921-928, San Francisco, California, June 1996.

Digital Library

[3]

C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. Computer Graphics (SIG-GRAPH'97), pages 353-360, August 1997.

Digital Library

[4]

P. J. Burt and E. H. Adelson. A multiresolution spline with applications to image mosaics. ACM Transactions on Graphics, 2(4):217-236, October 1983.

Digital Library

[5]

S. E. Chen. QuickTime VR - an image-based approach to virtual environment navigation. Computer Graphics (SIG- GRAPH'95), pages 29-38, August 1995.

Digital Library

[6]

J. De Bonet. Multiresolution sampling procedure for analysis and synthesis of texture images. Computer Graphics (SIG- GRAPH'97), pages 361-368, August 1997.

Digital Library

[7]

P. Debevec et al., editors. Image-Based Modeling, Rendering, and Lighting, SIGGRAPH'99 Course 39, August 1999.

Digital Library

[8]

P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Computer Graphics (SIGGRAPH'96), pages 11-20, August 1996.

Digital Library

[9]

A. A. Efros and T. K. Leung. Texture synthesis by nonparametric sampling. In Seventh International Conference on Computer Vision (ICCV'99), pages 1033-1038, Kerkyra, Greece, September 1999.

Digital Library

[10]

A. Finkelstein, C. E. Jacobs, and D. H. Salesin. Multiresolution video. Proceedings of SIGGRAPH 96, pages 281-290, August 1996. ISBN 0-201-94800-1. Held in New Orleans, Louisiana.

Digital Library

[11]

W. T. Freeman, E. H. Adelson, and D. J. Heeger. Motion without movement. Computer Graphics (Proceedings of SIG- GRAPH 91), 25(4):27-30, July 1991.

Digital Library

[12]

D. J. Heeger and J. R. Bergen. Pyramid-based texture analysis/synthesis. Proceedings of SIGGRAPH 95, pages 229-238, August 1995.

Digital Library

[13]

Workshop on Image-Based Modeling and Rendering, Stanford University, March 1998. http://graphics.stanford.edu/workshops/ibr98/.

[14]

C. E. Jacobs, A. Finkelstein, and D. H. Salesin. Fast multiresolution image querying. Proceedings of SIGGRAPH 95, pages 277-286, August 1995.

Digital Library

[15]

L. P. Kaelbling, M. L. Littman, and A. W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 1996.

Digital Library

[16]

T. Kanade, P. W. Rander, and P. J. Narayanan. Virtualized reality: constructing virtual worlds from real scenes. IEEE MultiMedia Magazine, 1(1):34-47, Jan-March 1997.

Digital Library

[17]

M. Levoy and P. Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, pages 31- 42, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[18]

L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIG- GRAPH'95), pages 39-46, August 1995.

Digital Library

[19]

S. Moezzi et al. Reality modeling and visualization from multiple video sequences. IEEE Computer Graphics and Applications, 16(6):58-63, November 1996.

Digital Library

[20]

S. A. Niyogi and E. H. Adelson. Analyzing and recognizing walking figures in xyt. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'94), pages 469-474, Seattle, Washington, June 1994.

[21]

F. Pighin, J. Hecker, D. Lischinski, D. H. Salesin, and R. Szeliski. Synthesizing realistic facial expressions from photographs. In Computer Graphics (SIGGRAPH'98) Proceedings, pages 75-84, Orlando, July 1998. ACM SIGGRAPH.

Digital Library

[22]

R. Polana and R. C. Nelson. Detection and recognition of periodic, nonrigid motion. International Journal of Computer Vision, 23(3):261-282, 1997.

Digital Library

[23]

S. Pollard et al. View synthesis by trinocular edge matching and transfer. In British Machine Vision Conference (BMVC98), Southampton, England, September 1998.

Digital Library

[24]

S. M. Seitz and C. M. Dyer. View morphing. In Computer Graphics Proceedings, Annual Conference Series, pages 21- 30, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[25]

S. M. Seitz and C. R. Dyer. View invariant analysis of cyclic motion. International Journal of Computer Vision, 25(3):231- 251, December 1997.

Digital Library

[26]

J. Shade, S. Gortler, L.-W. He, and R. Szeliski. Layered depth images. In Computer Graphics (SIGGRAPH'98) Proceedings, pages 231-242, Orlando, July 1998. ACM SIGGRAPH.

Digital Library

[27]

J. Shade, D. Lischinski, D. Salesin, T. DeRose, and J. Snyder. Hierarchical images caching for accelerated walkthroughs of complex environments. In Computer Graphics (SIG-GRAPH'96) Proceedings, pages 75-82, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

[28]

B. Shaw. Light of other days. In Other Days, Other Eyes. Ace Books, NewYork, 1972. (also published in Analog and various sci-fi anthologies).

[29]

H.-Y. Shum and R. Szeliski. Construction of panoramic mosaics with global and local alignment. International Journal of Computer Vision, 36(2):101-130, February 2000.

Digital Library

[30]

A. R. Smith and J. F. Blinn. Blue screen matting. In Computer Graphics Proceedings, Annual Conference Series, pages 259- 268, Proc. SIGGRAPH'96 (NewOrleans), August 1996. ACM SIGGRAPH.

Digital Library

[31]

R. Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models. In Computer Graphics (SIGGRAPH'97) Proceedings, pages 251-258, Los Angees, August 1997. ACM SIGGRAPH.

Digital Library

[32]

J. Torborg and J. T. Kajiya. Talisman: Commodity realtime 3D graphics for the PC. In Computer Graphics Proceedings, Annual Conference Series, pages 353-363, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH.

Digital Library

Cited By

Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Bai YGeng XMangalam KBar AYuille ADarrell TMalik JEfros A(2024)Sequential Modeling Enables Scalable Learning for Large Vision Models2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02157(22861-22872)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02157
Liu SRen ZGupta SWang S(2024)PhysGen: Rigid-Body Physics-Grounded Image-to-Video GenerationComputer Vision – ECCV 202410.1007/978-3-031-73007-8_21(360-378)Online publication date: 1-Oct-2024
https://doi.org/10.1007/978-3-031-73007-8_21
Show More Cited By

Recommendations

Video Textures
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...
A fast relighting engine for interactive cinematic lighting design
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

We present new techniques for interactive cinematic lighting design of complex scenes that use procedural shaders. Deep-framebuffers are used to store the geometric and optical information of the visible surfaces of an image. The geometric information ...
Animating pictures with stochastic motion textures
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

In this paper, we explore the problem of enhancing still pictures with subtly animated motions. We limit our domain to scenes containing passive elements that respond to natural forces in some fashion. We use a semi-automatic approach, in which a human ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

July 2000

547 pages

ISBN:1581132085

Chairmen:
Judith R. Brown
Coralville, IA
,
Kurt Akeley

Seminal Graphics Papers: Pushing the Boundaries, Volume 2
August 2023
893 pages
ISBN:9798400708978
DOI:10.1145/3596711
Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

ACM Press/Addison-Wesley Publishing Co.

United States

Publication History

Published: 01 July 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Author Tags

Qualifiers

Article

Conference

SIGGRAPH00

Sponsor:

SIGGRAPH

SIGGRAPH00: The 27th Internationl Conference on Computer Graphics and Interactive Techniques Conference

Acceptance Rates

SIGGRAPH '00 Paper Acceptance Rate 59 of 304 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

439
Total Citations
View Citations
4,319
Total Downloads

Downloads (Last 12 months)398
Downloads (Last 6 weeks)94

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Le TYao SWu CLee T(2024)Regenerating Arbitrary Video Sequences With Distillation Path-FindingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323773930:7(3622-3635)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3237739
Bai YGeng XMangalam KBar AYuille ADarrell TMalik JEfros A(2024)Sequential Modeling Enables Scalable Learning for Large Vision Models2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02157(22861-22872)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02157
Liu SRen ZGupta SWang S(2024)PhysGen: Rigid-Body Physics-Grounded Image-to-Video GenerationComputer Vision – ECCV 202410.1007/978-3-031-73007-8_21(360-378)Online publication date: 1-Oct-2024
https://doi.org/10.1007/978-3-031-73007-8_21
Mahapatra ASiarohin ALee HTulyakov SZhu J(2023)Text-Guided Synthesis of Eulerian CinemagraphsACM Transactions on Graphics10.1145/361832642:6(1-13)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618326
Cho HKomar MLindlbauer D(2023)RealityReplayProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108887:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610888
Jia SWang SLi TChern A(2023)Physical Cyclic AnimationsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069386:3(1-18)Online publication date: 24-Aug-2023
https://doi.org/10.1145/3606938
Kovar LGleicher MPighin F(2023)Motion GraphsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596788(723-732)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596788
Kwatra VSchödl AEssa ITurk GBobick A(2023)Graphcut Textures: Image and Video Synthesis Using Graph CutsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596773(583-592)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596773
Le TYeh CLin YLee T(2023)Animating Still Natural Images Using WarpingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351189419:1(1-24)Online publication date: 5-Jan-2023
https://dl.acm.org/doi/10.1145/3511894
Pajouheshgar EXu YZhang TSüsstrunk S(2023)DyNCA: Real-Time Dynamic Texture Synthesis Using Neural Cellular Automata2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01987(20742-20751)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01987
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents