Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1576246.1531328acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Edge-avoiding wavelets and their applications

Published: 27 July 2009 Publication History

Abstract

We propose a new family of second-generation wavelets constructed using a robust data-prediction lifting scheme. The support of these new wavelets is constructed based on the edge content of the image and avoids having pixels from both sides of an edge. Multi-resolution analysis, based on these new edge-avoiding wavelets, shows a better decorrelation of the data compared to common linear translation-invariant multi-resolution analyses. The reduced inter-scale correlation allows us to avoid halo artifacts in band-independent multi-scale processing without taking any special precautions. We thus achieve nonlinear data-dependent multi-scale edge-preserving image filtering and processing at computation times which are linear in the number of image pixels. The new wavelets encode, in their shape, the smoothness information of the image at every scale. We use this to derive a new edge-aware interpolation scheme that achieves results, previously computed by solving an inhomogeneous Laplace equation, through an explicit computation. We thus avoid the difficulties in solving large and poorly-conditioned systems of equations.
We demonstrate the effectiveness of the new wavelet basis for various computational photography applications such as multi-scale dynamic-range compression, edge-preserving smoothing and detail enhancement, and image colorization.

Supplementary Material

JPG File (tps023_09.jpg)
Zip (22-260.zip)
In the zip file there are: 1) A directory called results containing the resulting images and an html file (index.html) which allows viewers to browse these images. 2) A pdf file with supplemental material to the original paper.
MP4 File (tps023_09.mp4)

References

[1]
An, X., and Pellacini, F. 2008. Appprop: all-pairs appearancespace edit propagation. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 1--9.
[2]
Barash, D., and Comaniciu, D. 2004. A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. Image and Video Computing 22, 73--81.
[3]
Black, M. J., Sapiro, G., Marimont, D. H., and Heeger, D. 1998. Robust anisotropic diffusion. Image Processing, IEEE Transactions on 7, 3, 421--432.
[4]
Burrus, C., Gopinath, R., and Guo, H. 1998. Introduction to Wavelets and Wavelet Transforms, A Primer. Prentice Hall, N.J.
[5]
Burt, P. J., and Adelson, E. H. 1983. The laplacian pyramid as a compact image code. IEEE Transactions on Communications COM-31, 4, 532--540.
[6]
Burt, P. J. 1981. Fast filter transforms for image processing. Proc. SPIE 2825, vol. 16, 396--408.
[7]
Chan, T., and Zhou, H. M. 2003. ENO-wavelet Transforms and Some Applications in the book Beyond Wavelets. Academic Press.
[8]
Chan, T. F., Osher, S., and Shen, J. 2001. The digital tv filter and nonlinear denoising. IEEE Trans. Image Process 10, 231--241.
[9]
Choudhury, P., and Tumblin, J. 2005. The trilateral filter for high contrast images and meshes. In ACM SIGGRAPH Courses, ACM, New York, NY, USA, 5.
[10]
Claypoole, R., Davis, G., Sweldens, W., and Baraniuk, R. 1998. Adaptive wavelet transforms for image coding using lifting. In Proceedings of Data Compression Conference, 537--543.
[11]
Cohen, A., and Masson, R. 1999.Wavelet methods for secondorder elliptic problems, preconditioning, and adaptivity. SIAM J. Sci. Comput. 21, 3, 1006--1026.
[12]
Cohen, A., Daubechies, I., and Feauveau, J. C. 1992. Biorthogonal bases of compactly supported wavelets. In Comm. Pure Applied Math.
[13]
Dahmen, W. 1994. Some remarks on multiscale transformations, stability and biorthogonality. In Wavelets, Images, and Surface Fitting, Academic Press, 157--188.
[14]
Donoho, D. L. 1994. On minimum entropy segmentation. Tech. rep., Preprint:, Departement of Statistics, Standford University, Stanford, CA, 1994.
[15]
Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 257--266.
[16]
Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM, New York, NY, USA, vol. 27, 1--10.
[17]
Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 249--256.
[18]
Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. In ACM TOG, ACM, New York, NY, USA, 51.
[19]
Fattal, R., Carroll, R., and Agrawala, M. 2009. Edge-based image coarsening. to appear in ACM Trans. Graph. available at: www.cs.huji.ac.il/~raananf/projects/bic/m_paper.pdf.
[20]
Fattal, R. 2008. Single image dehazing. In Proc. ACM SIGGRAPH 27, 3, 1--9.
[21]
Fattal, R. 2009. A brief introduction to first- and second-generation wavelets. Tech. rep., Leibniz Center, Hebrew University, URL www.cs.huji.ac.il/~raananf/projects/eaw/sup_text.pdf.
[22]
Finlayson, G. D., Hordley, S. D., Drew, M. S., and Tj, E. N. 2002. Removing shadows from images. In In ECCV 2002: European Conference on Computer Vision, 823--836.
[23]
Fleishman, S., Drori, I., and Cohen-Or, D. 2003. Bilateral mesh denoising. ACM Trans. Graph. 22, 3, 950--953.
[24]
Gonzalez, R. C., and Woods, R. E. 2001. Digital Image Processing. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
[25]
Gortler, S. J., Schröder, P., Cohen, M. F., and Hanrahan, P. 1993. Wavelet radiosity. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 221--230.
[26]
Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 43--54.
[27]
Harten, A. 1996. Multiresolution representation of data: a general framework. SIAM J. Numer. Anal. 33, 3, 1205--1256.
[28]
Khan, E. A., Reinhard, E., Fleming, R. W., and Bülthoff, H. H. 2006. Image-based material editing. ACM Trans. Graph. 25, 3, 654--663.
[29]
Lagendijk, R. L., Biemond, J., and Boekee, D. E. 1988. Regularized iterative image restoration with ringing reduction. Acoustics, Speech, and Signal Processing {see also IEEE Transactions on Signal Processing}, IEEE Transactions on 36, 12, 1874--1888.
[30]
Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. In Proc. ACM SIGGRAPH 23, 3, 689--694.
[31]
Li, Y., Sharan, L., and Adelson, E. H. 2005. Compressing and companding high dynamic range images with subband architectures. In Proc. ACM SIGGRAPH 24, 3, 836--844.
[32]
Li, Y., Adelson, E. H., and Agarwala, A. 2008. Scribbleboost: Adding classification to edge-aware interpolation of local image and video adjustments. Comput. Graph. Forum 27, 4, 1255--1264.
[33]
Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 646--653.
[34]
Lounsbery, M., DeRose, T. D., and Warren, J. 1997. Multiresolution analysis for surfaces of arbitrary topological type. ACM Trans. Graph. 16, 1, 34--73.
[35]
Mallat, S. 1999. A Wavelet Tour of Signal Processing, Second Edition (Wavelet Analysis & Its Applications). Academic Press, September.
[36]
Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In In Proceedings of the European Conference on Computer Vision, 568--580.
[37]
Pellacini, F., and Lawrence, J. 2007. Appwand: editing measured materials using appearance-driven optimization. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 54.
[38]
Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. In Proc. ACM SIGGRAPH 22, 3, 313--318.
[39]
Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, 629--639.
[40]
Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23, 3, 664--672.
[41]
Peyré, G., and Mallat, S. 2005. Surface compression with geometric bandelets. ACM Trans. Graph. 24, 3, 601--608.
[42]
Schlick, C. 1994. Quantization techniques for visualization of high dynamic range pictures. In Photorealistic rendering techniques, proc. EGWR, Springer-Verlag, 7--20.
[43]
Schröder, P., and Sweldens, W. 1995. Spherical wavelets: efficiently representing functions on the sphere. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 161--172.
[44]
Secker, A., and Taubman, D. 2003. Lifting-based invertible motion adaptive transform (limat) framework for highly scalable video compression. Image Processing, IEEE Transactions on 12, 12 (Dec.), 1530--1542.
[45]
Shen, J., Jin, X., Zhou, C., and Wang, C. C. L. 2007. Technical section: Gradient based image completion by solving the poisson equation. Comput. Graph. 31, 1, 119--126.
[46]
Shepard, D. 1968. A two-dimensional interpolation function for irregularly-spaced data. In Proceedings of the 1968 23rd ACM national conference, ACM, New York, NY, USA, 517--524.
[47]
Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 315--321.
[48]
Sweldens, W. 1995. The lifting scheme: A new philosophy in biorthogonal wavelet constructions. In in Wavelet Applications in Signal and Image Processing III, 68--79.
[49]
Sweldens, W. 1998. The lifting scheme: a construction of second generation wavelets. SIAM J. Math. Anal. 29, 2, 511--546.
[50]
Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. In In Proc. ACM SIGGRAPH, ACM, New York, NY, USA, 1135--1143.
[51]
Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV '98: Proceedings of the Sixth International Conference on Computer Vision, IEEE Computer Society, Washington, DC, USA, 839.
[52]
Tumblin, J., and Turk, G. 1999. Lcis: a boundary hierarchy for detail-preserving contrast reduction. In In Proc. ACM SIGGRAPH, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 83--90.
[53]
Uytterhoeven, G., Roose, D., and Bultheel, A. 1999. Integer wavelet transforms using the lifting scheme. World Scientific and Engineering Society Press, 198--200.
[54]
Weiss, Y. 2001. Deriving intrinsic images from image sequences. IEEE International Conference on Computer Vision 2.
[55]
Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. Image Processing, IEEE Transactions on 15, 5, 1120--1129.

Cited By

View all
  • (2021)Multiscale cholesky preconditioning for ill-conditioned problemsACM Transactions on Graphics10.1145/3450626.345985140:4(1-13)Online publication date: Aug-2021
  • (2021)Multi-scale Image Decomposition Using a Local Statistical Edge Model2021 IEEE 7th International Conference on Virtual Reality (ICVR)10.1109/ICVR51878.2021.9483837(10-18)Online publication date: 20-May-2021
  • (2020)HDR Image Tone Mapping Approach Using Multiresolution and Piecewise Linear Perceptual QuantizationAdvances in Science, Technology and Engineering Systems Journal10.25046/aj0502765:2(606-613)Online publication date: 2020
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '09: ACM SIGGRAPH 2009 papers
July 2009
795 pages
ISBN:9781605587264
DOI:10.1145/1576246
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. constraint propagation
  2. data-dependent interpolation
  3. edge-preserving filtering
  4. lifting scheme
  5. wavelets

Qualifiers

  • Research-article

Conference

SIGGRAPH09
Sponsor:

Acceptance Rates

SIGGRAPH '09 Paper Acceptance Rate 78 of 439 submissions, 18%;
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Multiscale cholesky preconditioning for ill-conditioned problemsACM Transactions on Graphics10.1145/3450626.345985140:4(1-13)Online publication date: Aug-2021
  • (2021)Multi-scale Image Decomposition Using a Local Statistical Edge Model2021 IEEE 7th International Conference on Virtual Reality (ICVR)10.1109/ICVR51878.2021.9483837(10-18)Online publication date: 20-May-2021
  • (2020)HDR Image Tone Mapping Approach Using Multiresolution and Piecewise Linear Perceptual QuantizationAdvances in Science, Technology and Engineering Systems Journal10.25046/aj0502765:2(606-613)Online publication date: 2020
  • (2020)Real-time Image Smoothing via Iterative Least SquaresACM Transactions on Graphics10.1145/338888739:3(1-24)Online publication date: 6-Jun-2020
  • (2018)Piecewise linear perceptual quantizer as a non-uniform histogram equalization adjustment for contrast enhancement of tone mapped HDR images2018 9th International Symposium on Signal, Image, Video and Communications (ISIVC)10.1109/ISIVC.2018.8709168(27-32)Online publication date: Nov-2018
  • (2018)Region covariance based total variation optimization for structure-texture decompositionMultimedia Tools and Applications10.1007/s11042-017-5266-977:13(16985-17005)Online publication date: 1-Jul-2018
  • (2017)Efficient Gradient‐Domain Compositing Using an Approximate Curl‐free Wavelet ProjectionComputer Graphics Forum10.1111/cgf.1328636:7(207-215)Online publication date: 13-Oct-2017
  • (2016)Perceptual image quality enhancement for solar radio image2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX.2016.7498933(1-6)Online publication date: Jun-2016
  • (2016)Feature Learning Architecture Taxonomy and Neuroscience BackgroundComputer Vision Metrics10.1007/978-3-319-33762-3_9(319-374)Online publication date: 17-Sep-2016
  • (2016)Vision Pipelines and OptimizationsComputer Vision Metrics10.1007/978-3-319-33762-3_8(273-317)Online publication date: 17-Sep-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media