article

Flash matting

Authors:

Sing Bing Kang,

Heung-Yeung ShumAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 25, Issue 3

Pages 772 - 778

https://doi.org/10.1145/1141911.1141954

Published: 01 July 2006 Publication History

Abstract

In this paper, we propose a novel approach to extract mattes using a pair of flash/no-flash images. Our approach, which we call flash matting, was inspired by the simple observation that the most noticeable difference between the flash and no-flash images is the foreground object if the background scene is sufficiently distant. We apply a new matting algorithm called joint Bayesian flash matting to robustly recover the matte from flash/no-flash images, even for scenes in which the foreground and the background are similar or the background is complex. Experimental results involving a variety of complex indoors and outdoors scenes show that it is easy to extract high-quality mattes using an off-the-shelf, flash-equipped camera. We also describe extensions to flash matting for handling more general scenes.

Supplementary Material

JPG File (p772-sun-high.jpg)

Download
15.17 KB

JPG File (p772-sun-low.jpg)

Download
12.70 KB

High Resolution (p772-sun-high.mov)

Download
45.00 MB

Low Resolution (p772-sun-low.mov)

Download
16.60 MB

References

[1]

Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. In Proceedings of ACM SIGGRAPH 2005, 828--835.

Digital Library

[2]

Berman, A., Vlahos, P., and Dadourian, A. 2000. Comprehensive method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,345.

[3]

Bolle, R. M., Connell, J. H., Haas, N., Mohan, R., and Taubin, G. 1994. Object imaging system. U. S. Patent 5,631,976.

[4]

Canny, J. 1986. A computational approach to edge detection. IEEE Trans. on PAMI. 8, 6, 679--698.

Digital Library

[5]

Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A bayesian approach to digital matting. In Proceedings of CVPR 2001, vol. II, 264--271.

[6]

Chuang, Y.-Y., Agarwala, A., Curless, B., Salesin, D. H., and Szeliski, R. 2002. Video matting of complex scenes. In Proceedings of ACM SIGGRAPH 2002, 243--248.

Digital Library

[7]

Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. In Proceedings of ACM SIGGRAPH 2004, 673--678.

Digital Library

[8]

Feris, R., Raskar, R., Chen, L., Tan, K., and Turk, M. 2005. Discontinuity preserving stereo with small baseline multi-flash illumination. In Proceedings of ICCV 2005, vol. I, 412--419.

Digital Library

[9]

Fielding, R. 1972. The technique of special effects cinematography. In Focal/Hastings House, London, 3rd edition, 220--243.

[10]

Hillman, P., Hannah, J., and Renshaw, D. 2001. Alpha channel estimation in high resolution images and image sequences. In Proceedings of CVPR 2001, Vol. I, 1063--1068.

[11]

McGuire, M., Matusik, W., Pfister, H., Hughes, J. F., and Durand, F. 2005. Defocus video matting. In Proceedings of ACM SIGGRAPH, 567--576.

Digital Library

[12]

Nayar, S. K., and Narasimhan, S. G. 2002. Assorted pixels: Multi-sampled imaging with structural models. In Proceedings of ECCV 2002, vol. IV, 636--652.

Digital Library

[13]

Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama., K. 2004. Digital photography with flash and no-flash image pairs. In Proceedings of ACM SIGGRAPH 2004, 664--672.

Digital Library

[14]

Raskar, R., Han Tan, K., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging. In Proceedings of ACM SIGGRAPH 2004, 673--678.

Digital Library

[15]

Ruzon, M. A., and Tomasi, C. 2000. Alpha estimation in natural images. In Proceedings of CVPR 2000, 18--25.

[16]

Smith, A. R., and Blinn, J. F. 1996. Blue screen matting. In Proceedings of ACM SIGGRAPH 1996, 259--268.

Digital Library

[17]

Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In Proceedings of ACM SIGGRAPH, 315--321.

Digital Library

[18]

Vlahos, P. 1958. Composite photography utilizing sodium vapor illumination. U. S. Patent 3,095,304.

[19]

Wang, J., and Cohen, M. 2005. An iterative optimization approach for unified image segmentation and matting. In Proceedings of ICCV 2005, vol. II, 936--943.

Digital Library

Cited By

Hachmann HRosenhahn BZimmermann RShirmohammadi SGriwodz CHefeeda MWang M(2023)Color-aware Deep Temporal Backdrop Duplex Matting SystemProceedings of the 14th Conference on ACM Multimedia Systems10.1145/3587819.3590973(205-216)Online publication date: 7-Jun-2023
https://dl.acm.org/doi/10.1145/3587819.3590973
Maralan SCareaga CAksoy Y(2023)Computational Flash Photography through Intrinsics2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01598(16654-16662)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01598
Li XDu WChen D(2023)Object extraction from image with big size based on bilateral gridComputers and Electrical Engineering10.1016/j.compeleceng.2022.108454105(108454)Online publication date: Jan-2023
https://doi.org/10.1016/j.compeleceng.2022.108454
Show More Cited By

Index Terms

Flash matting
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Image manipulation
      1. Texturing
    2. Rendering
      1. Reflectance modeling

Recommendations

Flash matting
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

In this paper, we propose a novel approach to extract mattes using a pair of flash/no-flash images. Our approach, which we call flash matting, was inspired by the simple observation that the most noticeable difference between the flash and no-flash ...
Unsupervised and reliable image matting based on modified spectral matting

Spectral matting is the state-of-the-art image matting and also a milestone in theoretic matting research. For spectral matting without user intervention, the accuracy of alpha matte is low and the computational cost is high. Therefore, this paper ...
Automatic image matting using component-hue-difference-based spectral matting
ACIIDS'12: Proceedings of the 4th Asian conference on Intelligent Information and Database Systems - Volume Part II

This paper presents automatic image matting using component-hue-difference-based spectral matting to obtain accurate alpha mattes. Spectral matting is the state-of-the-art image matting and it is also a milestone in theoretic matting research. However, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 25, Issue 3

July 2006

742 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1141911

Issue’s Table of Contents

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2006

Published in TOG Volume 25, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,652
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hachmann HRosenhahn BZimmermann RShirmohammadi SGriwodz CHefeeda MWang M(2023)Color-aware Deep Temporal Backdrop Duplex Matting SystemProceedings of the 14th Conference on ACM Multimedia Systems10.1145/3587819.3590973(205-216)Online publication date: 7-Jun-2023
https://dl.acm.org/doi/10.1145/3587819.3590973
Maralan SCareaga CAksoy Y(2023)Computational Flash Photography through Intrinsics2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01598(16654-16662)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01598
Li XDu WChen D(2023)Object extraction from image with big size based on bilateral gridComputers and Electrical Engineering10.1016/j.compeleceng.2022.108454105(108454)Online publication date: Jan-2023
https://doi.org/10.1016/j.compeleceng.2022.108454
Sun ZWang JWu YNayar S(2022)Seeing Far in the Dark with Patterned FlashComputer Vision – ECCV 202210.1007/978-3-031-20068-7_41(709-727)Online publication date: 11-Nov-2022
https://doi.org/10.1007/978-3-031-20068-7_41
Jia J(2021)Matte ExtractionComputer Vision10.1007/978-3-030-63416-2_12(795-799)Online publication date: 13-Oct-2021
https://doi.org/10.1007/978-3-030-63416-2_12
Zou DChen XCao GWang X(2020)Unsupervised Video Matting via Sparse and Low-Rank RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2019.289533142:6(1501-1514)Online publication date: 1-Jun-2020
https://doi.org/10.1109/TPAMI.2019.2895331
Cao XWaechter MShi BGao YZheng BMatsushita Y(2020)Stereoscopic Flash and No-Flash Photography for Shape and Albedo Recovery2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00349(3427-3436)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.00349
Kim JRyu JKim J(2020)Deep Gradual Flash Fusion for Low-Light EnhancementJournal of Visual Communication and Image Representation10.1016/j.jvcir.2020.102903(102903)Online publication date: Sep-2020
https://doi.org/10.1016/j.jvcir.2020.102903
Chang YJung CSun JWang F(2020)Siamese Dense Network for Reflection Removal with Flash and No-Flash Image PairsInternational Journal of Computer Vision10.1007/s11263-019-01276-z128:6(1673-1698)Online publication date: 9-Jan-2020
https://dl.acm.org/doi/10.1007/s11263-019-01276-z
Matsuoka RShirai KOkuda M(2019)Reference-based local color distribution transformation method and its application to image integrationSignal Processing: Image Communication10.1016/j.image.2019.04.02076(231-242)Online publication date: Aug-2019
https://doi.org/10.1016/j.image.2019.04.020
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents