Article

AppWand: editing measured materials using appearance-driven optimization

Authors:

Fabio Pellacini,

Jason LawrenceAuthors Info & Claims

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Pages 54 - es

https://doi.org/10.1145/1275808.1276444

Published: 29 July 2007 Publication History

Abstract

We investigate a new approach to editing spatially- and temporally-varying measured materials that adopts a stroke-based workflow. In our system, a user specifies a small number of editing constraints with a 3-D painting interface which are smoothly propagated to the entire dataset through an optimization that enforces similar edits are applied to areas with similar appearance. The sparse nature of this appearance-driven optimization permits the use of efficient solvers, allowing the designer to interactively refine the constraints. We have found this approach supports specifying a wide range of complex edits that would not be easy with existing techniques which present the user with a fixed segmentation of the data. Furthermore, it is independent of the underlying reflectance model and we show edits to both analytic and non-parametric representations in examples from several material databases.

Supplementary Material

JPG File (pps054.jpg)

Download
5.97 KB

MP4 File (pps054.mp4)

Download
39.69 MB

References

[1]

Borg, I. 1996. Modern Multidimensional Scaling: Theory and Applications. Springer.

[2]

Brand, M. 2002. Charting a manifold. In Proceedings of Neural Information Processing Systems.

[3]

Colbert, M., Pattanaik, S., and Krivanek, J. 2006. BRDF-Shop: Creating physically correct bidirectional reflectance distribution functions. IEEE Computer Graphics and Applications.

Digital Library

[4]

Cook, R. L., and Torrance, K. E. 1981. A reflectance model for computer graphics. Computer Graphics (SIGGRAPH 1981).

Digital Library

[5]

Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and spatially-varying BRDFs from photometric stereo. In IEEE International Conference on Computer Vision.

Digital Library

[6]

Gu, J., Tu, C.-I., Ramamoorthi, R., Belhumeur, P., Matusik, W., and Nayar, S. 2006. Time-varying surface appearance: Acquisition, modeling and rendering. ACM Transactions on Graphics (SIGGGRAPH 2006) 25, 3.

Digital Library

[7]

Irony, R., Cohen-Or, D., and Lischinski, D. 2005. Colorization by example. In Proceedings of the Eurographics Symposium on Rendering.

[8]

Jain, A. K., Murty, M. N., and Flynn, P. J. 1999. Data clustering: A review. ACM Computing Surveys 31, 3.

Digital Library

[9]

Lafortune, E. P. F, Foo, S.-C., Torrance, K. E., and Greenberg, D. P. 1997. Non-linear approximation of reflectance functions. In Proceedings of ACM SIGGRAPH 1997.

Digital Library

[10]

Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material reprsentation and editing. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[11]

Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[12]

Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 2.

Digital Library

[13]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics (SIGGRAPH 2004).

Digital Library

[14]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[15]

Marschner, S. R., Westin, S. H., Arbree, A., and Moon, J. T. 2005. Measuring and modeling the appearance of finished wood. ACM Transactions on Graphics (SIGGRAPH 2005) 24, 3.

Digital Library

[16]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3.

Digital Library

[17]

Mount, D. M., and Arya, S., 2006. ANN: A library for Approximate Nearest Neighbor searching.

[18]

Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven navigation of analytical brdf models. In Proceedings of the Eurographics Symposium on Rendering.

[19]

Nicodemus, F. E., Richmond, J. C., and HSIA, J. J. 1977. Geometrical considerations and reflectance. National Bureau of Standards.

[20]

Peers, P., Vom Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S., and Dutré, P. 2006. A compact factored representation of heterogeneous subsurface scattering. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[21]

Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proceedings of ACM SIGGRAPH 2000.

Digital Library

[22]

Phong, B. T. 1975. Illumination for computer generated images. Communications of the ACM 18.

Digital Library

[23]

Robert, C. P., and Casella, G. 2004. Monte Carlo Statistical Methods. Springer.

Digital Library

[24]

Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500.

[25]

Saad, Y. 2003. Iterative Methods for Sparse Linear Systems, 2 ed. SIAM.

Digital Library

[26]

Tenenbaum, J. B., de Silva, V., and Langford, J. C. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500.

[27]

Wang, J., Tong, X., Lin, S., Bao, H., Guo, B., and Shum, H.-Y. 2006. Appearance manifolds for modeling time-variant appearance of materials. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[28]

Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In Computer Graphics (Proceedings of ACM SIGGRAPH 1992).

Digital Library

[29]

Westlund, H. B., and Meyer, G. W. 2001. Applying appearance standards to light reflection models. In Proceedings of ACM SIGGRAPH 2001.

Digital Library

Cited By

Xia ZHao JLi KTian ADu Z(2024)Edit propagation via color palettesComputers & Graphics10.1016/j.cag.2024.01.002119(103875)Online publication date: Apr-2024
https://doi.org/10.1016/j.cag.2024.01.002
Du ZZhou JXia ZSeng BXu K(2024)Palette-Based Content-Aware Image RecoloringComputational Visual Media10.1007/978-981-97-2092-7_12(240-258)Online publication date: 30-Mar-2024
https://doi.org/10.1007/978-981-97-2092-7_12
Subias JLagunas M(2023)In‐the‐wild Material Appearance Editing using Perceptual AttributesComputer Graphics Forum10.1111/cgf.1476542:2(333-345)Online publication date: 23-May-2023
https://doi.org/10.1111/cgf.14765
Show More Cited By

Index Terms

AppWand: editing measured materials using appearance-driven optimization
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms

Recommendations

AppWand: editing measured materials using appearance-driven optimization

We investigate a new approach to editing spatially- and temporally-varying measured materials that adopts a stroke-based workflow. In our system, a user specifies a small number of editing constraints with a 3-D painting interface which are smoothly ...
A precomputed polynomial representation for interactive BRDF editing with global illumination

The ability to interactively edit BRDFs in their final placement within a computer graphics scene is vital to making informed choices for material properties. We significantly extend previous work on BRDF editing for static scenes (with fixed lighting ...
Interactive albedo editing in path-traced volumetric materials

Materials such as clothing or carpets, or complex assemblies of small leaves, flower petals, or mosses, do not fit well into either BRDF or BSSRDF models. Their appearance is a complex combination of reflection, transmission, scattering, shadowing, and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '07: ACM SIGGRAPH 2007 papers

August 2007

1019 pages

ISBN:9781450378369

DOI:10.1145/1275808

Conference Chair:
Marc Levoy

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH07

Sponsor:

SIGGRAPH

SIGGRAPH07: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 5 - 9, 2007

California, San Diego

Acceptance Rates

SIGGRAPH '07 Paper Acceptance Rate 108 of 455 submissions, 24%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
986
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xia ZHao JLi KTian ADu Z(2024)Edit propagation via color palettesComputers & Graphics10.1016/j.cag.2024.01.002119(103875)Online publication date: Apr-2024
https://doi.org/10.1016/j.cag.2024.01.002
Du ZZhou JXia ZSeng BXu K(2024)Palette-Based Content-Aware Image RecoloringComputational Visual Media10.1007/978-981-97-2092-7_12(240-258)Online publication date: 30-Mar-2024
https://doi.org/10.1007/978-981-97-2092-7_12
Subias JLagunas M(2023)In‐the‐wild Material Appearance Editing using Perceptual AttributesComputer Graphics Forum10.1111/cgf.1476542:2(333-345)Online publication date: 23-May-2023
https://doi.org/10.1111/cgf.14765
Mylo MGiesel MZaidi QHullin MKlein RHullin MKlein RSchultz TYao A(2017)Appearance bendingProceedings of the conference on Vision, Modeling and Visualization10.2312/vmv.20171254(9-16)Online publication date: 25-Sep-2017
https://dl.acm.org/doi/10.2312/vmv.20171254
Bellini RKleiman YCohen-Or D(2016)Time-varying weathering in texture spaceACM Transactions on Graphics10.1145/2897824.292589135:4(1-11)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.1145/2897824.2925891
Talebi HMilanfar P(2014)Nonlocal Image EditingIEEE Transactions on Image Processing10.1109/TIP.2014.234887023:10(4460-4473)Online publication date: Oct-2014
https://doi.org/10.1109/TIP.2014.2348870
Hua MBie XZhang MWang W(2014)Edge-Aware Gradient Domain Optimization Framework for Image Filtering by Local PropagationProceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition10.1109/CVPR.2014.363(2838-2845)Online publication date: 23-Jun-2014
https://dl.acm.org/doi/10.1109/CVPR.2014.363
Talebi HMilanfar P(2013)Global image editing using the spectrum of affinity matrices2013 IEEE Global Conference on Signal and Information Processing10.1109/GlobalSIP.2013.6737005(771-774)Online publication date: Dec-2013
https://doi.org/10.1109/GlobalSIP.2013.6737005
Bie XHuang HWang W(2011)Real Time Edit Propagation by Efficient SamplingComputer Graphics Forum10.1111/j.1467-8659.2011.02059.x30:7(2041-2048)Online publication date: 4-Nov-2011
https://doi.org/10.1111/j.1467-8659.2011.02059.x
Xiao CYongwei Nfeng T(2011)Efficient Edit Propagation Using Hierarchical Data StructureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2010.12517:8(1135-1147)Online publication date: 1-Aug-2011
https://dl.acm.org/doi/10.1109/TVCG.2010.125
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents