research-article

Edge-preserving multiscale image decomposition based on local extrema

Authors:

Frédo DurandAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 28, Issue 5

Pages 1 - 9

https://doi.org/10.1145/1618452.1618493

Published: 01 December 2009 Publication History

Abstract

We propose a new model for detail that inherently captures oscillations, a key property that distinguishes textures from individual edges. Inspired by techniques in empirical data analysis and morphological image analysis, we use the local extrema of the input image to extract information about oscillations: We define detail as oscillations between local minima and maxima. Building on the key observation that the spatial scale of oscillations are characterized by the density of local extrema, we develop an algorithm for decomposing images into multiple scales of superposed oscillations.

Current edge-preserving image decompositions assume image detail to be low contrast variation. Consequently they apply filters that extract features with increasing contrast as successive layers of detail. As a result, they are unable to distinguish between high-contrast, fine-scale features and edges of similar contrast that are to be preserved. We compare our results with existing edge-preserving image decomposition algorithms and demonstrate exciting applications that are made possible by our new notion of detail.

References

[1]

Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Transactions on Graphics 25, 3, 637--645.

Digital Library

[2]

Burt, P. J., and Adelson, E. H. 1983. The laplacian pyramid as a compact image code. IEEE Trans. on Communications COM-31, 4, 532--540.

[3]

Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics, 103.

Digital Library

[4]

Choudhury, P., and Tumblin, J. 2005. The trilateral filter for high contrast images and meshes. In SIGGRAPH '05: ACM SIGGRAPH 2005 Courses, ACM, New York, NY, USA, 5.

Digital Library

[5]

Damerval, C., Meignen, S., and Perrier, V. 2005. A fast algorithm for bidimensional emd. Signal Processing Letters, IEEE 12, 10 (Oct.), 701--704.

[6]

Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. In ACM Transactions on Graphics: SIGGRAPH '02, ACM Press, New York, NY, USA, 257--266.

Digital Library

[7]

Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics, 67.

Digital Library

[8]

Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics, 51.

Digital Library

[9]

Huang. 1998. The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 454, 1971 (March), 903--995.

[10]

Lagendijk, R. L., Biemond, J., and Boekee, D. E. 1988. Regularized iterative image restoration with ringing reduction. IEEE Trans. on Signal Processing (Acoustics, Speech, and Signal Processing) 36, 12, 1874--1888.

[11]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics 23, 689--694.

Digital Library

[12]

Li, H., Yang, L., and Huang, D. 2005. The study of the intermittency test filtering character of hilbert-huang transform. Mathematics and Computers in Simulation 70, 1, 22--32.

Digital Library

[13]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3, 646--653.

Digital Library

[14]

Liu, Z., and Peng, S. 2005. Boundary processing of bidimensional emd using texture synthesis. Signal Processing Letters, IEEE 12, 1 (Jan.), 33--36.

[15]

Nunes, J., Niang, O., Bouaoune, Y., Delechelle, E., and Bunel, P. 2003. Texture analysis based on the bidimensional empirical mode decomposition with gray-level co-occurrence models. Signal Processing and Its Applications, 2003. Proceedings. 2 (July), 633--635 vol. 2.

[16]

Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In Proceedings of SIGGRAPH 2001, ACM, NY, USA, 433--442.

Digital Library

[17]

Pattanaik, S. N., Fairchild, M., Ferwerda, J., and Greenberg, D. P., 1998. Multiscale model of adaptation, spatial vision and color appearance.

[18]

Rahman, Z. U., and Woodell, G. A. 1997. A multi-scale retinex for bridging the gap between color images and the human observation of scenes. In IEEE Trans. on Image Processing: Special Issue on Color Processing 6(7, 965--976.

Digital Library

[19]

Serra, J., and Vincent, L. 1992. An overview of morphological filtering. In Circuits, Systems and Signal Processing, 47--108.

Digital Library

[20]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In In Proc. of the Sixth International Conference on Computer Vision, Bombay, India, January 1998.

Digital Library

[21]

Tumblin, J., and Turk, G. 1999. Lcis: a boundary hierarchy for detail-preserving contrast reduction. In Proceedings of SIGGRAPH '99, ACM Press/Addison-Wesley Publishing Co., NY, USA, 83--90.

Digital Library

Cited By

Du JLi WPeng YZong Q(2025)Image fusion by multiple features in the propagated filtering domainBiomedical Signal Processing and Control10.1016/j.bspc.2024.106990100(106990)Online publication date: Feb-2025
https://doi.org/10.1016/j.bspc.2024.106990
Chu FPang YSun XCao JSong Z(2024)Pseudo-Multispectral Pedestrian Detection with Deep Thermal Feature GuidanceGuidance, Navigation and Control10.1142/S273748072441004804:03Online publication date: 20-Jul-2024
https://doi.org/10.1142/S2737480724410048
Hu Z(2024)Dynamic path planning based on multi-heuristic factor ant colony and DWA algorithmThird International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024)10.1117/12.3031419(355)Online publication date: 19-Jul-2024
https://doi.org/10.1117/12.3031419
Show More Cited By

Index Terms

Edge-preserving multiscale image decomposition based on local extrema
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations
  2. Computer graphics
    1. Animation
      1. Physical simulation
    2. Shape modeling
      1. Point-based models
2. Mathematics of computing
  1. Continuous mathematics
    1. Topology
      1. Geometric topology

Recommendations

Edge-preserving multiscale image decomposition based on local extrema
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

We propose a new model for detail that inherently captures oscillations, a key property that distinguishes textures from individual edges. Inspired by techniques in empirical data analysis and morphological image analysis, we use the local extrema of ...
Single Image Dehazing Method Based on Cartoon-Texture Decomposition
CSAE '18: Proceedings of the 2nd International Conference on Computer Science and Application Engineering

In1 this paper, we propose an efficient image dehazing method based on cartoon-texture decomposition. First, we decompose the hazy image into two parts: the cartoon part and the texture part. and then the cartoon part is dehazed and the texture part is ...
Structure–texture decomposition-based dehazing of a single image with large sky area
Abstract
Traditional dehazing methods based on restoration are prone to color distortion and noise amplification when dealing with hazy image with large sky area. To improve dehazing effect, we propose a dehazing algorithm based on image structure–texture ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 28, Issue 5

December 2009

646 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1618452

Issue’s Table of Contents

Copyright © 2009 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Published in TOG Volume 28, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

228
Total Citations
View Citations
1,821
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)5

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Du JLi WPeng YZong Q(2025)Image fusion by multiple features in the propagated filtering domainBiomedical Signal Processing and Control10.1016/j.bspc.2024.106990100(106990)Online publication date: Feb-2025
https://doi.org/10.1016/j.bspc.2024.106990
Chu FPang YSun XCao JSong Z(2024)Pseudo-Multispectral Pedestrian Detection with Deep Thermal Feature GuidanceGuidance, Navigation and Control10.1142/S273748072441004804:03Online publication date: 20-Jul-2024
https://doi.org/10.1142/S2737480724410048
Hu Z(2024)Dynamic path planning based on multi-heuristic factor ant colony and DWA algorithmThird International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024)10.1117/12.3031419(355)Online publication date: 19-Jul-2024
https://doi.org/10.1117/12.3031419
Xiong YYang YZeng LWang XPan ZJiang L(2024)Deep unsupervised nonconvex optimization for edge-preserving image smoothingJournal of Electronic Imaging10.1117/1.JEI.33.4.04300133:04Online publication date: 1-Jul-2024
https://doi.org/10.1117/1.JEI.33.4.043001
Yang XXu WSu Y(2024) Tone mapping algorithm based on BL-Hilbert-L 2 decomposition model for HDR image Engineering Research Express10.1088/2631-8695/ad7cc56:3(035244)Online publication date: 30-Sep-2024
https://doi.org/10.1088/2631-8695/ad7cc5
Li SLiu YZeng JLiu YLi YXie Q(2024)Image smoothing method based on global gradient sparsity and local relative gradient constraint optimizationScientific Reports10.1038/s41598-024-65886-514:1Online publication date: 2-Jul-2024
https://doi.org/10.1038/s41598-024-65886-5
Pradhan KPatra S(2024)A semantic edge-aware parameter efficient image filtering techniqueComputers & Graphics10.1016/j.cag.2024.104068124(104068)Online publication date: Nov-2024
https://doi.org/10.1016/j.cag.2024.104068
Bu PWang HYang TZhao H(2024)Linear time manageable edge-aware filtering on complementary tree structuresComputers and Graphics10.1016/j.cag.2023.12.006118:C(133-145)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.cag.2023.12.006
Zeng LDong WHui HWang XYang Y(2024)Structure-preserving image filtering with soft power iteration clusteringSignal, Image and Video Processing10.1007/s11760-024-03426-418:11(7763-7777)Online publication date: 31-Jul-2024
https://doi.org/10.1007/s11760-024-03426-4
Zhu DWang WXue XXie HCheng GWang F(2024)Structure-preserving image smoothing via contrastive learningThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02897-940:8(5139-5153)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00371-023-02897-9
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents