article

AppWand: editing measured materials using appearance-driven optimization

Authors:

Fabio Pellacini,

Jason LawrenceAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 54 - es

https://doi.org/10.1145/1276377.1276444

Published: 29 July 2007 Publication History

Abstract

We investigate a new approach to editing spatially- and temporally-varying measured materials that adopts a stroke-based workflow. In our system, a user specifies a small number of editing constraints with a 3-D painting interface which are smoothly propagated to the entire dataset through an optimization that enforces similar edits are applied to areas with similar appearance. The sparse nature of this appearance-driven optimization permits the use of efficient solvers, allowing the designer to interactively refine the constraints. We have found this approach supports specifying a wide range of complex edits that would not be easy with existing techniques which present the user with a fixed segmentation of the data. Furthermore, it is independent of the underlying reflectance model and we show edits to both analytic and non-parametric representations in examples from several material databases.

Supplementary Material

JPG File (pps054.jpg)

Download
5.97 KB

MP4 File (pps054.mp4)

Download
39.69 MB

References

[1]

Borg, I. 1996. Modern Multidimensional Scaling: Theory and Applications. Springer.

[2]

Brand, M. 2002. Charting a manifold. In Proceedings of Neural Information Processing Systems.

[3]

Colbert, M., Pattanaik, S., and Krivanek, J. 2006. BRDF-Shop: Creating physically correct bidirectional reflectance distribution functions. IEEE Computer Graphics and Applications.

Digital Library

[4]

Cook, R. L., and Torrance, K. E. 1981. A reflectance model for computer graphics. Computer Graphics (SIGGRAPH 1981).

Digital Library

[5]

Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and spatially-varying BRDFs from photometric stereo. In IEEE International Conference on Computer Vision.

Digital Library

[6]

Gu, J., Tu, C.-I., Ramamoorthi, R., Belhumeur, P., Matusik, W., and Nayar, S. 2006. Time-varying surface appearance: Acquisition, modeling and rendering. ACM Transactions on Graphics (SIGGGRAPH 2006) 25, 3.

Digital Library

[7]

Irony, R., Cohen-Or, D., and Lischinski, D. 2005. Colorization by example. In Proceedings of the Eurographics Symposium on Rendering.

[8]

Jain, A. K., Murty, M. N., and Flynn, P. J. 1999. Data clustering: A review. ACM Computing Surveys 31, 3.

Digital Library

[9]

Lafortune, E. P. F, Foo, S.-C., Torrance, K. E., and Greenberg, D. P. 1997. Non-linear approximation of reflectance functions. In Proceedings of ACM SIGGRAPH 1997.

Digital Library

[10]

Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material reprsentation and editing. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[11]

Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[12]

Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 2.

Digital Library

[13]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics (SIGGRAPH 2004).

Digital Library

[14]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[15]

Marschner, S. R., Westin, S. H., Arbree, A., and Moon, J. T. 2005. Measuring and modeling the appearance of finished wood. ACM Transactions on Graphics (SIGGRAPH 2005) 24, 3.

Digital Library

[16]

Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3.

Digital Library

[17]

Mount, D. M., and Arya, S., 2006. ANN: A library for Approximate Nearest Neighbor searching.

[18]

Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven navigation of analytical brdf models. In Proceedings of the Eurographics Symposium on Rendering.

[19]

Nicodemus, F. E., Richmond, J. C., and HSIA, J. J. 1977. Geometrical considerations and reflectance. National Bureau of Standards.

[20]

Peers, P., Vom Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S., and Dutré, P. 2006. A compact factored representation of heterogeneous subsurface scattering. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[21]

Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proceedings of ACM SIGGRAPH 2000.

Digital Library

[22]

Phong, B. T. 1975. Illumination for computer generated images. Communications of the ACM 18.

Digital Library

[23]

Robert, C. P., and Casella, G. 2004. Monte Carlo Statistical Methods. Springer.

Digital Library

[24]

Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500.

[25]

Saad, Y. 2003. Iterative Methods for Sparse Linear Systems, 2 ed. SIAM.

Digital Library

[26]

Tenenbaum, J. B., de Silva, V., and Langford, J. C. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500.

[27]

Wang, J., Tong, X., Lin, S., Bao, H., Guo, B., and Shum, H.-Y. 2006. Appearance manifolds for modeling time-variant appearance of materials. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3.

Digital Library

[28]

Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In Computer Graphics (Proceedings of ACM SIGGRAPH 1992).

Digital Library

[29]

Westlund, H. B., and Meyer, G. W. 2001. Applying appearance standards to light reflection models. In Proceedings of ACM SIGGRAPH 2001.

Digital Library

Cited By

Huang XRitschel TSeidel HMemari PSingh G(2023)Patternshop: Editing Point Patterns by Image ManipulationACM Transactions on Graphics10.1145/359241842:4(1-14)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592418
Sharma PPhilip JGharbi MFreeman BDurand FDeschaintre V(2023)Materialistic: Selecting Similar Materials in ImagesACM Transactions on Graphics10.1145/359239042:4(1-14)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592390
Gong BWang YHan XDou QEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611957(8004-8015)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611957
Show More Cited By

Index Terms

AppWand: editing measured materials using appearance-driven optimization
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms

Recommendations

AppWand: editing measured materials using appearance-driven optimization
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

We investigate a new approach to editing spatially- and temporally-varying measured materials that adopts a stroke-based workflow. In our system, a user specifies a small number of editing constraints with a 3-D painting interface which are smoothly ...
A precomputed polynomial representation for interactive BRDF editing with global illumination

The ability to interactively edit BRDFs in their final placement within a computer graphics scene is vital to making informed choices for material properties. We significantly extend previous work on BRDF editing for static scenes (with fixed lighting ...
Interactive bi-scale editing of highly glossy materials

We present a new technique for bi-scale material editing using Spherical Gaussians (SGs). To represent large-scale appearances, an effective BRDF that is the average reflectance of small-scale details is used. The effective BRDF is calculated from the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Copyright © 2007 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

84
Total Citations
View Citations
970
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Huang XRitschel TSeidel HMemari PSingh G(2023)Patternshop: Editing Point Patterns by Image ManipulationACM Transactions on Graphics10.1145/359241842:4(1-14)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592418
Sharma PPhilip JGharbi MFreeman BDurand FDeschaintre V(2023)Materialistic: Selecting Similar Materials in ImagesACM Transactions on Graphics10.1145/359239042:4(1-14)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592390
Gong BWang YHan XDou QEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611957(8004-8015)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611957
Hu YHe CDeschaintre VDorsey JRushmeier H(2022)An Inverse Procedural Modeling Pipeline for SVBRDF MapsACM Transactions on Graphics10.1145/350243141:2(1-17)Online publication date: 4-Jan-2022
https://dl.acm.org/doi/10.1145/3502431
Du ZLei KXu KTan JGingold Y(2021)Video recoloring via spatial-temporal geometric palettesACM Transactions on Graphics10.1145/3450626.345967540:4(1-16)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459675
Lavoué GBonneel NFarrugia JSoler C(2021)Perceptual quality of BRDF approximations: dataset and metricsComputer Graphics Forum10.1111/cgf.14263640:2(327-338)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142636
Zsolnai‐Fehér KWonka PWimmer M(2020)Photorealistic Material Editing Through Direct Image ManipulationComputer Graphics Forum10.1111/cgf.1405739:4(107-120)Online publication date: 20-Jul-2020
https://doi.org/10.1111/cgf.14057
Guo JGuo YPan JLu W(2020)BRDF Analysis with Directional Statistics and its ApplicationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.287270926:3(1476-1489)Online publication date: 1-Mar-2020
https://doi.org/10.1109/TVCG.2018.2872709
Gui YZeng G(2020)Joint learning of visual and spatial features for edit propagation from a single imageThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-019-01633-636:3(469-482)Online publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1007/s00371-019-01633-6
Wang YLiu YXu K(2019)An Improved Geometric Approach for Palette‐based Image Decomposition and RecoloringComputer Graphics Forum10.1111/cgf.1381238:7(11-22)Online publication date: 14-Nov-2019
https://doi.org/10.1111/cgf.13812
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents