research-article

Multiresolution Textures from Image Sequences

Authors:

Eyal Ofek,

Erez Shilat,

Ari Rappoport,

Michael WermanAuthors Info & Claims

IEEE Computer Graphics and Applications, Volume 17, Issue 2

Pages 18 - 29

https://doi.org/10.1109/38.574667

Published: 01 March 1997 Publication History

Publisher Site

Abstract

Rendering is one of the most important tasks in computer graphics and animation. It is widely recognized that texture maps are essential for adding to the visual content of the rendered image. Extraction of textures from a single photograph poses severe difficulties and is sometimes impossible, while artificial texture synthesis does not address the full range of desired textures. In this paper we present a method for computing high-quality, multiresolution textures from an image sequence. The method has the following features: (1) it can be used with images in which the textures are present in different resolutions and different perspective distortions; (2) it can extract textures from objects with any known 3D geometric structure; specifically, we are not restricted to planar textures; (3) removal of directional illumination artifacts such as highlights and reflections; (4) efficient storage of the resulting texture in a multiresolution data structure; and (5) no restrictions are imposed on the computed texture, which can be a constant color texture or a richly colored one. We present an especially attractive application of our technique, in which an existing real object participates in an animation sequence and is endowed with synthetic behavior.

References

[1]

J.T. Kajiya, "The Rendering Equation," Computer Graphics (Proc. Siggraph), Vol. 20, No. 2, Aug. 1986, pp. 143-149.

Digital Library

Google Scholar

[2]

P.J. Burt and R.J. Kolczynski, "Enhanced Image Capture through Fusion," Fourth Int'l. Conf. on Computer Vision, IEEE Press, Piscataway, N.J., 1993, pp. 173-182.

Google Scholar

[3]

M. Irani and S. Peleg, "Super Resolution from Image Sequences," Proc. 10th Int'l. Conf. on Pattern Recognition, IEEE Computer Society Press, Los Alamitos, Calif., 1990, pp. 115-120.

Google Scholar

[4]

D.F. Berman J.T. Bartell and D.H. Salesin, "Multiresolution Painting and Compositing," Proc. Siggraph 94, ACM Press, New York, 1994, pp. 85-90.

Digital Library

Google Scholar

[5]

L.B. Wolff, "Scene Understanding from Propagation and Consistency of Polarization-based Constraints," Proc. Computer Vision and Pattern Recognition, IEEE Press, Piscataway, N.J., 1994, pp. 1000-1004.

Google Scholar

[6]

G.E. Healey S.A. Shafer and L.B. Wolff, Color, Jones and Barlett Publishers, London, 1992.

Digital Library

Google Scholar

[7]

S.A. Shafer, "Using Color to Separate Reflection Components," Color Research and Application, Vol. 10, No. 4, Winter 1985, pp. 43-51.

Crossref

Google Scholar

[8]

S.W. Lee and R. Bajcsy, "Detection of Specularity Using Color and Multiple Views," Image and Vision Computing, Vol. 10, No. 10, Dec. 1992, pp. 643-653.

Digital Library

Google Scholar

[9]

E. Shilat, et al., "Tracking a Rigid Object Along Image Sequences Using a Three-Frame Matching Primitive," Tech. Report, Institute of Computer Science, Hebrew University of Jerusalem, http://www.cs.huji.ac.il/papers/IP/index.html.

Google Scholar

[10]

M. Oren and S. Nayar, "Generalization of the Lambertian Model and Implication for Machine Vision," Int'l J. of Comp. Vision, Vol. 14, No. 3, April 1995, pp. 227-251.

Digital Library

Google Scholar

[11]

L.B. Wolf, "Diffuse and Specular Reflection from Dielectric Surfaces," Image Understanding Workshop, Morgan Kaufman, San Mateo, Calif., 1993, pp. 1025-1030.

Google Scholar

[12]

A. Blake and H. Bülthoff, "Shape from Specularities: Computation and Psychophysics," Phil. Trans. Royal Soc. of London, B 331, 1991, pp. 237-252.

Crossref

Google Scholar

[13]

L. Williams, "Pyramidal Parametrics," Computer Graphics (Proc. Siggraph), Vol. 17, No. 3, July 1983, pp. 1-11.

Digital Library

Google Scholar

[14]

Y. Zakai and A. Rappoport, "Three-Dimensional Modeling and Effects on Still Images, Computer Graphics Forum (Proc. Eurographics), Vol. 15, No. 3, 1996, pp. 3-10.

Google Scholar

Cited By

View all

Santos RBaranoski G(2022)Observation-driven generation of texture maps depicting dust accumulation over timeThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02457-739:5(1943-1957)Online publication date: 2-Apr-2022
https://dl.acm.org/doi/10.1007/s00371-022-02457-7
Zhao XZhao ZSchwing A(2022)Initialization and Alignment for Adversarial Texture OptimizationComputer Vision – ECCV 2022 Workshops10.1007/978-3-031-25066-8_34(587-604)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1007/978-3-031-25066-8_34
Huang JDai AGuibas LNiessner M(2017)3DliteACM Transactions on Graphics10.1145/3130800.313082436:6(1-14)Online publication date: 20-Nov-2017
https://dl.acm.org/doi/10.1145/3130800.3130824
Show More Cited By

Index Terms

Multiresolution Textures from Image Sequences
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Appearance and texture representations
  2. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Technical Section: Reflectance modeling for a textured object under uncontrolled illumination from high dynamic range maps

During the past several years, considerable work has been presented on the methods for measuring and modeling the observed reflectance properties of materials. However, most of these works have been done under controlled lighting configurations, and ...
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

In this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...
Flux-Limited Diffusion for Multiple Scattering in Participating Media

For the rendering of multiple scattering effects in participating media, methods based on the diffusion approximation are an extremely efficient alternative to Monte Carlo path tracing. However, in sufficiently transparent regions, classical diffusion ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Computer Graphics and Applications

IEEE Computer Graphics and Applications Volume 17, Issue 2

March 1997

93 pages

ISSN:0272-1716

Issue’s Table of Contents

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 March 1997

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Santos RBaranoski G(2022)Observation-driven generation of texture maps depicting dust accumulation over timeThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02457-739:5(1943-1957)Online publication date: 2-Apr-2022
https://dl.acm.org/doi/10.1007/s00371-022-02457-7
Zhao XZhao ZSchwing A(2022)Initialization and Alignment for Adversarial Texture OptimizationComputer Vision – ECCV 2022 Workshops10.1007/978-3-031-25066-8_34(587-604)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1007/978-3-031-25066-8_34
Huang JDai AGuibas LNiessner M(2017)3DliteACM Transactions on Graphics10.1145/3130800.313082436:6(1-14)Online publication date: 20-Nov-2017
https://dl.acm.org/doi/10.1145/3130800.3130824
Bi SKalantari NRamamoorthi R(2017)Patch-based optimization for image-based texture mappingACM Transactions on Graphics10.1145/3072959.307361036:4(1-11)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073610
Zhou QKoltun V(2014)Color map optimization for 3D reconstruction with consumer depth camerasACM Transactions on Graphics10.1145/2601097.260113433:4(1-10)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601134
Pu YZhou JYuan X(2010)Fractional differential maskIEEE Transactions on Image Processing10.1109/TIP.2009.203598019:2(491-511)Online publication date: 1-Feb-2010
https://dl.acm.org/doi/10.1109/TIP.2009.2035980
Colombo CDel Bimbo APernici F(2005)Metric 3D Reconstruction and Texture Acquisition of Surfaces of Revolution from a Single Uncalibrated ViewIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2005.1427:1(99-114)Online publication date: 1-Jan-2005
https://dl.acm.org/doi/10.1109/TPAMI.2005.14
Pollefeys MVan Gool LVergauwen MVerbiest FCornelis KTops JKoch R(2004)Visual Modeling with a Hand-Held CameraInternational Journal of Computer Vision10.1023/B:VISI.0000025798.50602.3a59:3(207-232)Online publication date: 21-Sep-2004
https://dl.acm.org/doi/10.1023/B%3AVISI.0000025798.50602.3a
Lieng E(2003)Quadtree decomposition texture analysis in paper formation determinationProceedings of the 13th Scandinavian conference on Image analysis10.5555/1763974.1763984(51-59)Online publication date: 29-Jun-2003
https://dl.acm.org/doi/10.5555/1763974.1763984
Ismert RBala KGreenberg DZyda MCapps MPausch RBishop G(2003)Detail synthesis for image-based texturingProceedings of the 2003 symposium on Interactive 3D graphics10.1145/641480.641512(171-175)Online publication date: 27-Apr-2003
https://dl.acm.org/doi/10.1145/641480.641512
Show More Cited By

Abstract

References

Cited By

Index Terms

Recommendations

Technical Section: Reflectance modeling for a textured object under uncontrolled illumination from high dynamic range maps

Image-based rendering of diffuse, specular and glossy surfaces from a single image

Flux-Limited Diffusion for Multiple Scattering in Participating Media

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations