article

Open access

Interactive digital photomontage

Authors:

Aseem Agarwala,

Mira Dontcheva,

Maneesh Agrawala,

Steven Drucker,

Michael CohenAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 23, Issue 3

Pages 294 - 302

https://doi.org/10.1145/1015706.1015718

Published: 01 August 2004 Publication History

Abstract

We describe an interactive, computer-assisted framework for combining parts of a set of photographs into a single composite picture, a process we call "digital photomontage." Our framework makes use of two techniques primarily: graph-cut optimization, to choose good seams within the constituent images so that they can be combined as seamlessly as possible; and gradient-domain fusion, a process based on Poisson equations, to further reduce any remaining visible artifacts in the composite. Also central to the framework is a suite of interactive tools that allow the user to specify a variety of high-level image objectives, either globally across the image, or locally through a painting-style interface. Image objectives are applied independently at each pixel location and generally involve a function of the pixel values (such as "maximum contrast") drawn from that same location in the set of source images. Typically, a user applies a series of image objectives iteratively in order to create a finished composite. The power of this framework lies in its generality; we show how it can be used for a wide variety of applications, including "selective composites" (for instance, group photos in which everyone looks their best), relighting, extended depth of field, panoramic stitching, clean-plate production, stroboscopic visualization of movement, and time-lapse mosaics.

Supplementary Material

MOV File (pps013.mov)

Download
10.99 KB

References

[1]

AKERS, D., LOSASSO, F., KLINGNER, J., AGRAWALA, M., RICK, J., AND HANRAHAN, P. 2003. Conveying shape and features with image-based relighting. In IEEE Visualization, 349--354.

Digital Library

[2]

BOYKOV, Y., VEKSLER, O., AND ZABIH, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222--1239.

Digital Library

[3]

BRAUN, M. 1992. Picturing Time: The Work of Etienne-Jules Marey. The University of Chicago Press.

[4]

BURT, P., AND KOLCZYNSKI, R. 1993. Enhanced image capture through fusion. In International Conference on Computer Vision (ICCV 93), 173--182.

[5]

DANIELSSON, P.-E. 1980. Euclidean distance mapping. Computer Graphics and Image Processing 14, 227--248.

[6]

DAVIS, J. 1998. Mosaics of scenes with moving objects. In Computer Vision and pattern Recognition (CVPR 98), 354--360.

Digital Library

[7]

FATTAL, R., LISCHINSKI, D., AND WERMAN, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3, 249--256.

Digital Library

[8]

FREEMAN, W. T., AND ZHANG, H. 2003. Shape-time photography. In Conference on Computer Vision and Pattern Recognition (CVPR 03), 151--157.

[9]

HAEBERLI, P. 1994. Grafica Obscura web site. http://www.sgi.com/grafica/.

[10]

KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graph-cut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.

Digital Library

[11]

LEVIN, A., ZOMET, A., PELEG, S., AND WEISS, Y. 2004. Seamless image stitching in the gradient domain. In European Conference on Computer Vision (ECCV 04), (to appear).

[12]

LUCAS, B. D., AND KANADE, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81), 674--679.

[13]

MASSEY, M., AND BENDER, W. 1996. Salient stills: Process and practice. IBM Systems Journal 35, 3&4, 557--574.

Digital Library

[14]

MEYER, C. 2000. Matrix Analysis and Applied Linear Algebra. Society for Industrial and Applied Mathematics.

Digital Library

[15]

MORTENSEN, E. N., AND BARRETT, W. A. 1995. Intelligent scissors for image composition. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 191--198.

Digital Library

[16]

MUTTER, S., AND KRAUSE, M. 1992. Surrational Images: Photomontages. University of Illinois Press.

[17]

MUYBRIDGE, E. 1955. The human figure in motion. Dover Publications, Inc.

[18]

OGDEN, J. M., ADELSON, E. H., BERGEN, J., AND BURT, P. 1985. pyramid-based computer graphics. RCA Engineer 30, 5, 4--15.

[19]

PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3, 313--318.

Digital Library

[20]

RASKAR, R., ILIE, A., AND YU, J. 2004. Image fusion for context enhancement and video surrealism. In NPAR 2004: Third International Symposium on Non-Photorealistic Rendering, (to appear).

Digital Library

[21]

REINHARD, E., STARK, M., SHIRLEY, P., AND FERWERDA, J. 2002. Photographic tone reproduction for digital images. ACM Transactions on Graphics 21, 3, 267--276.

Digital Library

[22]

REJLANDER, O., 1857. Two ways of life. Photograph.

[23]

ROBINSON, H. P. 1869. Pictorial Effect in Photography: Being Hints on Composition and Chiaroscuro for Photographers. Piper & Carter.

[24]

SYNCROSCOPY, 2003. Auto-montage.

[25]

SZELISKI, R., AND SHUM, H.-Y. 1997. Creating full view panoramic mosaics and environment maps. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 251--258.

Digital Library

[26]

UELSMANN, J., AND COLEMAN, A. D. 1992. Jerry Uelsmann: Photo Synthesis. University Press of Florida.

[27]

UYTTENDAELE, M., EDEN, A., AND SZELISKI, R. 2001. Eliminating ghosting and exposure artifacts in image mosaics. In Conference on Computer Vision and Pattern Recognition (CVPR 01), 509--516.

[28]

WEISS, Y. 2001. Deriving intrinsic images from image sequences. In International Conference On Computer Vision (ICCV 01), 68--75.

Cited By

Chen LDing RZhang S(2024)Adaptive focus stacking for large depth-of-field microscopic structured-light 3D imagingApplied Optics10.1364/AO.51799763:12(3219)Online publication date: 16-Apr-2024
https://doi.org/10.1364/AO.517997
Rajaram SNuman NKumaravel BMarquardt NWilson A(2024)BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AIProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676326(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676326
Hays JEfros A(2023)Scene Completion Using Millions of PhotographsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596783(679-685)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596783
Show More Cited By

Index Terms

Interactive digital photomontage
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Interactive digital photomontage
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

We describe an interactive, computer-assisted framework for combining parts of a set of photographs into a single composite picture, a process we call "digital photomontage." Our framework makes use of two techniques primarily: graph-cut optimization, ...
Interactive Digital Photomontage
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

We describe an interactive, computer-assisted framework for combining parts of a set of photographs into a single composite picture, a process we call "digital photomontage." Our framework makes use of two techniques primarily: graph-cut optimization, ...
Multi-scale image harmonization
SIGGRAPH '10: ACM SIGGRAPH 2010 papers

Traditional image compositing techniques, such as alpha matting and gradient domain compositing, are used to create composites that have plausible boundaries. But when applied to images taken from different sources or shot under different conditions, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 23, Issue 3

August 2004

684 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1015706

Editor:
John C. Hart

Issue’s Table of Contents

Seminal Graphics Papers: Pushing the Boundaries, Volume 2
August 2023
893 pages
ISBN:9798400708978
DOI:10.1145/3596711
Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

526
Total Citations
View Citations
5,061
Total Downloads

Downloads (Last 12 months)160
Downloads (Last 6 weeks)23

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen LDing RZhang S(2024)Adaptive focus stacking for large depth-of-field microscopic structured-light 3D imagingApplied Optics10.1364/AO.51799763:12(3219)Online publication date: 16-Apr-2024
https://doi.org/10.1364/AO.517997
Rajaram SNuman NKumaravel BMarquardt NWilson A(2024)BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AIProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676326(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676326
Hays JEfros A(2023)Scene Completion Using Millions of PhotographsSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596783(679-685)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596783
Avidan SShamir A(2023)Seam Carving for Content-Aware Image ResizingSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596776(609-617)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596776
Liu ZHe QWang LFang XTang B(2023)LFTransNet: Light Field Salient Object Detection via a Learnable Weight DescriptorIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.328146533:12(7764-7773)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TCSVT.2023.3281465
Pereira DVieira MVillela S(2023)Graph Cuts and Deep Neural Networks for Fire Detection2023 36th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)10.1109/SIBGRAPI59091.2023.10347132(79-84)Online publication date: 6-Nov-2023
https://doi.org/10.1109/SIBGRAPI59091.2023.10347132
Venjarski JTibenský ŠRozinaj G(2023)Analyzing Classical and LDI Depth-Aware Image Stitching for Enhanced Virtual View Representation2023 30th International Conference on Systems, Signals and Image Processing (IWSSIP)10.1109/IWSSIP58668.2023.10180238(1-5)Online publication date: 27-Jun-2023
https://doi.org/10.1109/IWSSIP58668.2023.10180238
Kim HLee GChoi YKim JZhu J(2023)3D-aware Blending with Generative NeRFs2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.02094(22849-22861)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.02094
Nie LLin CLiao KLiu SZhao Y(2023)Parallax-Tolerant Unsupervised Deep Image Stitching2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.00680(7365-7374)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.00680
Sella EFiebelman GHedman PAverbuch-Elor H(2023)Vox-E: Text-guided Voxel Editing of 3D Objects2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.00046(430-440)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.00046
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents