Article

Object-based image editing

Authors:

William A. Barrett,

Alan S. CheneyAuthors Info & Claims

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

Pages 777 - 784

https://doi.org/10.1145/566570.566651

Published: 01 July 2002 Publication History

Abstract

We introduce Object-Based Image Editing (OBIE) for real-time animation and manipulation of static digital photographs. Individual image objects (such as an arm or nose, Figure 1) are selected, scaled, stretched, bent, warped or even deleted (with automatic hole filling) - at the object, rather than the pixel level - using simple gesture motions with a mouse. OBIE gives the user direct, local control over object shape, size, and placement while dramatically reducing the time required to perform image editing tasks.Object selection is performed by manually collecting (subobject) regions detected by a watershed algorithm. Objects are tessellated into a triangular mesh, allowing shape modification to be performed in real time using OpenGL's texture mapping hardware.Through the use of anchor points, the user is able to interactively perform editing operations on a whole object, or just part(s) of an object - including moving, scaling, rotating, stretching, bending, and deleting. Indirect manipulation of object shape is also provided through the use of sliders and Bezier curves. Holes created by movement are filled in real-time based on surrounding texture.When objects stretch or scale, we provide a method for preserving texture granularity or scale. We also present a texture brush, which allows the user to "paint" texture into different parts of an image, using existing image texture(s).OBIE allows the user to perform interactive, high-level editing of image objects in a few seconds to a few ten's of seconds

References

[1]

ADOBE SYSTEMS INCORPORATED 2000. Adobe Photoshop Version 6.0 User Guide.

[2]

BEIER, T. AND NEELY, S. 1992. Feature Based Image Metamorphosis. In Computer Graphics (Proceedings of ACM SIGGRAPH 92), 26(2), ACM, 35-42.

Digital Library

[3]

BERN, M. AND EPPSTEIN, D. 1992. Polynomial-size nonobtuse triangulation of polygons. International Journal of Computational Geometry and Applications 2(3), 241-255.

[4]

BOOKSTEIN, F. L. 1989. Principal Warps: thin-plate splines and the decomposition of deformations. In IEEE Transactions on PAMI, 11(6), 567-585.

Digital Library

[5]

EFROS, A. A. AND LEUNG, T. K. 1999. Texture Synthesis by Non-parametric Sampling. In IEEE International Conference on Computer Vision (ICCV 99), Corfu, Greece.

Digital Library

[6]

EFROS, A. A. AND FREEMAN, W. 2001. Image Quilting for Texture Synthesis and Transfer. In Proceedings of ACM SIGGRAPH 2001, ACM Press/ACM SIGGRAPH, New York. E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 341-346.

Digital Library

[7]

ELDER, J. H. AND GOLDBERG, R. M. 1998. Image Editing in the Contour Domain. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 98), 374-281.

Digital Library

[8]

GAO, P. AND SEDERBERG, T. W. 1998. A work minimization approach to image morphing, The Visual Computer 14, 390-400.

[9]

THE GIMP. http://www.gimp.org.

[10]

HARRISON, P. 2001. A Non-hierarchical Procedure for Re-synthesis of Complex Textures. In Proceedings of Winter School of Computer Graphics 2001, 190-197.

[11]

HASBRO, INC. 2001. Mrs. Potato Head. http://www.hasbropreschool.com/

[12]

MCINERNEY, T. AND TERZOPOULOS, D. 2000. T-Snakes: Topology Adaptive Snakes. In Medical Image Analysis, Vol. 4, 73-91.

[13]

MORTENSEN, E. N., AND BARRETT, W. A. 2001. A Confidence Measure for Boundary Detection and Object Selection. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), Vol. 1, 477-484.

[14]

MORTENSEN, E. N. AND BARRETT, W. A. 1995. Intelligent Scissors for Image Composition. In Proceedings of ACM SIGGRAPH 1995, ACM Press/ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 191-198.

Digital Library

[15]

MORTENSEN, E. N. AND BARRETT, W. A. 1998. Interactive Segmentation with Intelligent Scissors. In Graphical/Models and Image Processing, 60(5), 349-384.

Digital Library

[16]

MORTENSEN, E. N. AND BARRETT, W. A. 1999. Toboggan-Based Intelligent Scissors with a Four Parameter Edge Model. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 99), 452-458.

[17]

MORTENSEN, E. N., REESE, L. J., AND BARRETT, W. A. 2000. Intelligent Selection Tools. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 99), Vol. II, 776-777.

[18]

MOUNT, D. M., AND SAALFELD, A. 1988. Globally-equiangular Triangulations of Co-circular Point in O(n log n) Time. In Proceedings of the 4th Symposium on Comp. Geometry, ACM.

Digital Library

[19]

PRAUN, E., ET AL. 2000. Lapped Textures. In Proceedings of ACM SIGGRAPH 2000, ACM Press/ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 465-470.

Digital Library

[20]

REESE, L. J. 1999. Intelligent Paint: Region-Based Interactive Image Segmentation. Masters Thesis, Department of Computer Science, Brigham Young University, Provo, UT.

[21]

SANDER, P. V., ET AL. 2000. Silhouette Clipping. In Proceedings of ACM SIGGRAPH 2000, ACM Press/ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 327-334.

Digital Library

[22]

SCANSOFT, INC. 2001. Kai's SuperGoo. http://www.scansoft.com/products/goo.

[23]

SHEWCHUK, J. R. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. First Workshop on Applied Computational Geometry, ACM, 124-133.

Digital Library

[24]

SIBSON, R. 1978. Locally equiangular triangulations. Computer Journal, 21:243-245.

[25]

SMITH, M. D. 2002. Sally's Flower. Graphics Lab, Brigham Young University. [email protected]. Received by personal communication.

[26]

VINCENT, L. AND SOILLE, P. 1991. Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6):583-598.

Digital Library

[27]

WEI, L. AND LEVOY, M. 2000. Fast Texture Synthesis using Tree-structured Vector Quantization. In Proceedings of ACM SIGGRAPH 2000, ACM Press/ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, ACM, 479-488.

Digital Library

[28]

WOLBERG, G. 1998. Image Morphing: a Survey, The Visual Computer 14, 360-372.

[29]

XU, Y., ET AL. 2000. Chaos Mosaic: Fast and Memory Efficient Texture Synthesis. Technical Report MSR-TR-2000-32, Microsoft Research.

[30]

YU, XIAOHUA, MORSE, B. S., AND SEDERBERG, T. W. 2001. Image Reconstruction Using Data-Dependent Triangulation. IEEE Computer Graphics and Applications Vol. 21, No. 3, 62-68.

Digital Library

Cited By

Reza MLaundry NMusabirov IDushniku PYu ZMittal KGrossman TLiut MKuzminykh AWilliams J(2024)ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641899(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641899
Zhang YZhang XShi CWu XLi XPeng JCao KLv JZhou J(2023)Pluralistic Face Inpainting With Transformation of Attribute InformationIEEE Transactions on Multimedia10.1109/TMM.2022.322996825(7967-7979)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3229968
Feng ZHe YWang XGao XLei JJin CSong MLarochelle HRanzato MHadsell RBalcan MLin H(2020)One-sample guided object representation disassemblingProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3497559(21878-21888)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3497559
Show More Cited By

Index Terms

Object-based image editing
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Object-based image editing

We introduce Object-Based Image Editing (OBIE) for real-time animation and manipulation of static digital photographs. Individual image objects (such as an arm or nose, Figure 1) are selected, scaled, stretched, bent, warped or even deleted (with ...
Plenoptic Image Editing

This paper presents a new class of interactive image editing operations designed to maintain consistency between multiple images of a physical 3D scene. The distinguishing feature of these operations is that edits to any one image propagate ...
Video textures
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

July 2002

574 pages

ISBN:1581135211

DOI:10.1145/566570

Conference Chair:
Tom Appolloni
Harris Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH02

Sponsor:

SIGGRAPH

SIGGRAPH02: The 29th International Conference on Computer Graphics and Interactive Techniques

July 23 - 26, 2002

Texas, San Antonio

Acceptance Rates

SIGGRAPH '02 Paper Acceptance Rate 67 of 358 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
2,488
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)9

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Reza MLaundry NMusabirov IDushniku PYu ZMittal KGrossman TLiut MKuzminykh AWilliams J(2024)ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641899(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641899
Zhang YZhang XShi CWu XLi XPeng JCao KLv JZhou J(2023)Pluralistic Face Inpainting With Transformation of Attribute InformationIEEE Transactions on Multimedia10.1109/TMM.2022.322996825(7967-7979)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3229968
Feng ZHe YWang XGao XLei JJin CSong MLarochelle HRanzato MHadsell RBalcan MLin H(2020)One-sample guided object representation disassemblingProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3497559(21878-21888)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3497559
Torreño AOnaindia EKomenda AŠtolba M(2017)Cooperative Multi-Agent PlanningACM Computing Surveys10.1145/312858450:6(1-32)Online publication date: 22-Nov-2017
https://dl.acm.org/doi/10.1145/3128584
Lamash YFischer ALessick J(2017)Finite Element Based Interactive Elastic Image RegistrationMedical Image Understanding and Analysis10.1007/978-3-319-60964-5_52(594-604)Online publication date: 22-Jun-2017
https://doi.org/10.1007/978-3-319-60964-5_52
Kansal RKumar S(2015)A vectorization framework for constant and linear gradient filled regionsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-014-0997-331:5(717-732)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1007/s00371-014-0997-3
Kholgade NSimon TEfros ASheikh Y(2014)3D object manipulation in a single photograph using stock 3D modelsACM Transactions on Graphics10.1145/2601097.260120933:4(1-12)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601209
Jung S(2013)A Modified Model of the Just Noticeable Depth Difference and Its Application to Depth Sensation EnhancementIEEE Transactions on Image Processing10.1109/TIP.2013.226315022:10(3892-3903)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1109/TIP.2013.2263150
Liu DKlette R(2013)Inverse Skeletal StrokesRevised Selected Papers of the GCCV 2013, GPID 2013, PAESNPR 2013, and QACIVA 2013 on Image and Video Technology --- PSIVT 2013 Workshops - Volume 833410.1007/978-3-642-53926-8_1(1-11)Online publication date: 28-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-53926-8_1
Gui YMa LYin CChen Z(2012)Preserving global features of fluid animation from a single image using video examplesJournal of Zhejiang University SCIENCE C10.1631/jzus.C110034213:7(510-519)Online publication date: 6-Jul-2012
https://doi.org/10.1631/jzus.C1100342
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents