Article

Open access

The lumigraph

Authors:

Steven J. Gortler,

Radek Grzeszczuk,

Richard Szeliski,

Michael F. CohenAuthors Info & Claims

SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques

Pages 43 - 54

https://doi.org/10.1145/237170.237200

Published: 01 August 1996 Publication History

Abstract

This paper discusses a new method for capturing the complete appearance of both synthetic and real world objects and scenes, representing this information, and then using this representation to render images of the object from new camera positions. Unlike the shape capture process traditionally used in computer vision and the rendering process traditionally used in computer graphics, our approach does not rely on geometric representations. Instead we sample and reconstruct a 4D function, which we call a Lumigraph. The Lumigraph is a subsetof the complete plenoptic function that describes the flow of light at all positions in all directions. With the Lumigraph, new images of the object can be generated very quickly, independent of the geometric or illumination complexity of the scene or object. The paper discusses a complete working system including the capture of samples, the construction of the Lumigraph, and the subsequent rendering of images from this new representation.

References

[1]

ADELSON, E. H., AND BERGEN, J. R. The plenoptic function and the elements of early vision. In ComputationalModels of Visual Processing, Landy and Movshon, Eds. MIT Press, Cambridge, Massachusetts, 1991, ch. 1.

[2]

ASHDOWN, I. Near-field photometry: A new approach. Journal of the Illumination Engineering Society 22, 1 (1993), 163-180.

[3]

BENTON, S. A. Survey of holographic stereograms. Proceedings of the SPIE 391 (1982), 15-22.

[4]

BOLLES, R. C., BAKER, H. H., AND MARIMONT, D. H. Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision 1 (1987), 7-55.

[5]

BURT, P. J. Moment images, polynomial fit flters, and the problem of surface interpolation. In Proceedings of Computer Vision and Pattern Recognition (June 1988), IEEE Computer Society Press, pp. 144-152.

[6]

CHEN, S. E. Quicktime VR - an image-based approach to virtual environment navigation. In Computer Graphics, Annual Conference Series, 1995, pp. 29-38.

Digital Library

[7]

CHEN, S. E., AND WILLIAMS, L. View interpolation for image synthesis. In Computer Graphics, Annual Conference Series, 1993, pp. 279-288.

Digital Library

[8]

CHUI, C. K. An Introduction to Wavelets. Academic Press Inc., 1992.

Digital Library

[9]

HALLE, M. W. Holographic stereograms as discrete imaging systems. Practical Holography VIII (SPIE) 2176 (1994), 73-84.

[10]

HOPPE, H. Progressive meshes. In Computer Graphics, Annual Conference Series, 1996.

Digital Library

[11]

KATAYAMA, A., TANAKA, K., OSHINO, T., AND TAMURA, H. A viewpoint independent stereoscopic display using interpolation of multi-viewpoint images. Steroscopic displays and virtal reality sytems H (SPIE) 2409 (1995), 11-20.

[12]

KLINKER, G. J. A PhysicaI Applvach to Color Image Understanding. A K Peters, Wellesley, Massachusetts, 1993.

Digital Library

[13]

LAURENTINI, A. The visual hull concept for silhouette-based image understanding. IEEE Transactions on Pattern Analysis and Machine lntelligence 16, 2 (February 1994), 150-162.

Digital Library

[14]

LAVEAU, S., AND FAUGERAS, O. 3-D scene representation as a collection of images and fundamental matrices. Tech. Rep. 2205, INRIA-Sophia Antipolis, February 1994.

[15]

LEVIN, R. E. Photometric characteristics of light-controlling apparatus. Illuminating Engineering 66, 4 (1971), 205-215.

[16]

LEVOY, M., AND HANRAHAN, P. Light-fieldrendering. In Computer Graphics, Annual Conference Series, 1996.

Digital Library

[17]

LEWIS, R. R., AND FOURNIER, A. Light-driven global illumination with a wavelet representation of light transport. UBC CS Technical Reports 95-28, University of British Columbia, 1995.

[18]

LITWINOWICZ, P., AND WILLIAMS, L. Animating images with drawings. In Computer Graphics, Annual Conference Series, 1994, pp. 409-412.

Digital Library

[19]

MCMILLAN, L., AND BISHOP, G. Plenoptic modeling: An image-based rendering system. In Computer Graphics, Annual Conference Series, 1995, pp. 39-46.

Digital Library

[20]

MITCHELL, D. P. Generating antialiased images at low sampling densities. Computer Graphics 21, 4 (1987), 65-72.

Digital Library

[21]

POTMESIL, M. Generating octree models of 3D objects from their silhouettes in a sequence of images. Computer Vision, Graphics, and Image P~vcessing 40 (1987), 1-29.

Digital Library

[22]

POWELL, M. J. D., AND SWANN, J. Weighted uniform sampling - a monte carlo technique for reducing variance. J. Inst. Maths Applics 2 (1966), 228-236.

[23]

ROSENFELD, A., AND KAK, A. C. DigitalPicture P~vcessing. Academic Press, New York, New York, 1976.

Digital Library

[24]

SIMONCELLI, E. P., FREEMAN, W. T., ADELSON, E. H., AND HEEGER, D. J. Shiftable multiscale transforms. IEEE Transactions on Information Theory 38 (1992), 587-607.

Digital Library

[25]

SNYDER, J. M., AND KAJIYA, J. Y. Generative modeling: A symbolic system for geometric modeling. Computer Graphics 26, 2 (1992), 369-379.

Digital Library

[26]

SZELISKI, R. Rapid octree construction from image sequences. CVGIP: Image Understanding58, 1 (July 1993), 23-32.

Digital Library

[27]

TAUBIN, G. A signal processing approach to fair surface design. In Computer Graphics, Annual Conference Series, 1995, pp. 351-358.

Digital Library

[28]

TERZOPOULOS, D. Regularization of inverse visual problems involving discontinuities. IEEE PAMI 8, 4 (July 1986), 413-424.

Digital Library

[29]

TSAI, R. Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelfTV cameras and lenses. IEEE Journal of Robotics and Automation RA-3, 4 (August 1987), 323-344.

[30]

WERNER, Y., HERSCH, R. D., AND HLAVAC, g. Rendering real-world objects using view interpolation. In Fifth International Conference on Computer Vision (ICCV' 95) (Cambridge, Massachusetts, June 1995), pp. 957-962.

Digital Library

[31]

WILLSON, R. G. Modeling and Calibration of Automated Zoom Lenses. PhD thesis, Carnegie Mellon University, 1994.

Digital Library

Cited By

Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Khanal BOm MRijal SOjha V(2024)Alignment of a 360° image with posed color images for locally accurate texturing of 3D meshFrontiers in Computer Science10.3389/fcomp.2024.13881746Online publication date: 19-Sep-2024
https://doi.org/10.3389/fcomp.2024.1388174
Mahmoudpour SPagliari CSchelkens P(2024)Learning-based light field imaging: an overviewJournal on Image and Video Processing10.1186/s13640-024-00628-12024:1Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1186/s13640-024-00628-1
Show More Cited By

Index Terms

The lumigraph
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
      2. Computer vision representations
        Appearance and texture representations
  2. Computer graphics
2. Theory of computation
  1. Randomness, geometry and discrete structures

Recommendations

The Lumigraph
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

This paper discusses a new method for capturing the complete appearance of bothsynthetic and real world objects and scenes,representing this information, and then using this representation to render images of the object from new camera positions. Unlike ...
Unstructured lumigraph rendering
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

We describe an image based rendering approach that generalizes many current image based rendering algorithms, including light field rendering and view-dependent texture mapping. In particular, it allows for lumigraph-style rendering from a set of input ...
Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images
EGSR '06: Proceedings of the 17th Eurographics conference on Rendering Techniques

We present a novel relighting approach that does not assume that the illumination is known or controllable. Instead, we estimate the illumination and texture from given multi-view images captured under a single illumination setting, given the object ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques

August 1996

528 pages

ISBN:0897917464

DOI:10.1145/237170

Chairman:
John Fujii
Hewlett-Packard

Seminal Graphics Papers: Pushing the Boundaries, Volume 2
August 2023
893 pages
ISBN:9798400708978
DOI:10.1145/3596711
Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

Copyright © 1996 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 1996

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Qualifiers

Article

Conference

SIGGRAPH96

Sponsor:

SIGGRAPH

SIGGRAPH96: 23rd International Conference on Computer Graphics and Interactive Techniques

Acceptance Rates

SIGGRAPH '96 Paper Acceptance Rate 52 of 247 submissions, 21%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,733
Total Citations
View Citations
7,178
Total Downloads

Downloads (Last 12 months)559
Downloads (Last 6 weeks)81

Reflects downloads up to 23 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Khanal BOm MRijal SOjha V(2024)Alignment of a 360° image with posed color images for locally accurate texturing of 3D meshFrontiers in Computer Science10.3389/fcomp.2024.13881746Online publication date: 19-Sep-2024
https://doi.org/10.3389/fcomp.2024.1388174
Mahmoudpour SPagliari CSchelkens P(2024)Learning-based light field imaging: an overviewJournal on Image and Video Processing10.1186/s13640-024-00628-12024:1Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1186/s13640-024-00628-1
Gavane AWatson B(2024)Light Field Display Point RenderingProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36513007:1(1-18)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3651300
Chen BYan ZHan BNahrstedt KOkoshi TKo JLiKamWa R(2024)NeRFHub: A Context-Aware NeRF Serving Framework for Mobile Immersive ApplicationsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661879(85-98)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661879
Shih MHuang JKim CShah RKopf JGao C(2024)Modeling Ambient Scene Dynamics for Free-view SynthesisACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657488(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657488
Jiang KFu YVarma T MBelhe YWang XSu HRamamoorthi R(2024)A Construct-Optimize Approach to Sparse View Synthesis without Camera PoseACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657427(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657427
Xia MEchevarria JXie MWong T(2024)LF2MV: Learning an Editable Meta-View Towards Light Field RepresentationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322077330:3(1672-1684)Online publication date: Mar-2024
https://doi.org/10.1109/TVCG.2022.3220773
Park BGo HKim C(2024)Bridging Implicit and Explicit Geometric Transformation for Single-Image View SynthesisIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.337875746:9(6326-6340)Online publication date: Sep-2024
https://doi.org/10.1109/TPAMI.2024.3378757
Li YWang XZhou GZhu HWang Q(2024)Sheared Epipolar Focus Spectrum for Dense Light Field ReconstructionIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3337516(1-15)Online publication date: 2024
https://doi.org/10.1109/TPAMI.2023.3337516
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents