research-article

PortraitSketch: face sketching assistance for novices

Authors:

Aaron Hertzmann,

Holger WinnemöllerAuthors Info & Claims

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Pages 407 - 417

https://doi.org/10.1145/2642918.2647399

Published: 05 October 2014 Publication History

Abstract

We present PortraitSketch, an interactive drawing system that helps novices create pleasing, recognizable face sketches without requiring prior artistic training. As the user traces over a source portrait photograph, PortraitSketch automatically adjusts the geometry and stroke parameters (thickness, opacity, etc.) to improve the aesthetic quality of the sketch. We present algorithms for adjusting both outlines and shading strokes based on important features of the underlying source image. In contrast to automatic stylization systems, PortraitSketch is designed to encourage a sense of ownership and accomplishment in the user. To this end, all adjustments are performed in real-time, and the user ends up directly drawing all strokes on the canvas. The findings from our user study suggest that users prefer drawing with some automatic assistance, thereby producing better drawings, and that assistance does not decrease the perceived level of involvement in the creative process.

Supplementary Material

suppl.mov (uistf3631-file3.mov)

Supplemental video

Download
15.84 MB

References

[1]

Arvo, J., and Novins, K. Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-drawn Shapes. In Proc. UIST (2000), 73--80.

Digital Library

[2]

Barla, P., Thollot, J., and Sillion, F. Geometric Clustering for Line Drawing Simplification. In Proc. EGSR (2005).

Digital Library

[3]

Berger, I., Shamir, A., Mahler, M., Carter, E., and Hodgins, J. Style and Abstraction in Portrait Sketching. ACM Trans. Graph. 32, 4 (July 2013).

Digital Library

[4]

Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. Where Do People Draw Lines? ACM Trans. Graph. 27, 3 (Aug. 2008).

Digital Library

[5]

Comaniciu, D., and Meer, P. Mean Shift: A Robust Approach Toward Feature Space Analysis. IEEE Trans. PAMI 24, 5 (May 2002), 603--619.

Digital Library

[6]

Cummmings, D., Vides, F., and Hammond, T. I Don't Believe My Eyes!: Geometric Sketch Recognition for a Computer Art Tutorial. In Proc. SBIM (2012).

Digital Library

[7]

Dixon, D., Prasad, M., and Hammond, T. iCanDraw: Using Sketch Recognition and Corrective Feedback to Assist a User in Drawing Human Faces. In Proc. CHI (2010).

Digital Library

[8]

Eitz, M., Hays, J., and Alexa, M. How Do Humans Sketch Objects? ACM Trans. Graph. 31, 4 (July 2012).

Digital Library

[9]

Fernquist, J., Grossman, T., and fitzmaurice, G. Sketch-sketch Revolution: An Engaging Tutorial System for Guided Sketching and Application Learning. In Proc. UIST (2011).

Digital Library

[10]

Flagg, M., and Rehg, J. M. Projector-guided painting. In Proc. UIST (2006).

Digital Library

[11]

Freund, J., and Perles, B. A new look at quartiles of ungrouped data. American Stat 41 (1987), 200--203.

[12]

Iarussi, E., Bousseau, A., and Tsandilas, T. The Drawing Assistant: Automated Drawing Guidance and Feedback from Photographs. In Proc. UIST (2013).

Digital Library

[13]

Kazi, R. H., Igarashi, T., Zhao, S., and Davis, R. Vignette: Interactive texture design and manipulation with freeform gestures for pen-and-ink illustration. In Proc. CHI (2012).

Digital Library

[14]

Lee, Y. J., Zitnick, C. L., and Cohen, M. F. ShadowDraw: Real-time User Guidance for Freehand Drawing. ACM Trans. Graph. 30, 4 (July 2011).

Digital Library

[15]

Lewis, J. R. Pairs of latin squares to counterbalance sequential effects and pairing of conditions and stimuli. In Proc. Human Factors and Ergonomics (1989).

[16]

Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. Real-time Drawing Assistance Through Crowdsourcing. ACM Trans. Graph. 32, 4 (July 2013).

Digital Library

[17]

Pusch, R., Samavati, F., Nasri, A., and Wyvill, B. Improving the sketch-based interface. The Visual Computer 23, 9--11 (2007), 955--962.

Digital Library

[18]

Salisbury, M. P., Anderson, S. E., Barzel, R., and Salesin, D. H. Interactive pen-and-ink illustration. In Proc. SIGGRAPH (1994).

Digital Library

[19]

Saragih, J. M., Lucey, S., and Cohn, J. F. Deformable Model fitting by Regularized Landmark Mean-Shift. Int. J. Comput. Vision 91, 2 (Jan. 2011), 200--215.

Digital Library

[20]

Turk, G., and Banks, D. Image-guided Streamline Placement. In Proc. SIGGRAPH (1996), 453--460.

Digital Library

[21]

Winnemöller, H., Kyprianidis, J. E., and Olsen, S. C. XDoG: An eXtended difference-of-Gaussians compendium including advanced image stylization . Computers & Graphics 36, 6 (2012), 740--753.

Digital Library

[22]

Zhao, M., and Zhu, S.-C. Artistic Rendering of Portraits. In Image and Video-Based Artistic Stylisation, P. Rosin and J. Collomosse, Eds. Springer, London, 2013.

[23]

Zitnick, C. L. Handwriting Beautification Using Token Means. ACM Trans. Graph. 32, 4 (July 2013).

Digital Library

Cited By

Zhang YKong ZFunabiki NHsu C(2024)A Study of a Drawing Exactness Assessment Method Using Localized Normalized Cross-Correlations in a Portrait Drawing Learning Assistant SystemComputers10.3390/computers1309021513:9(215)Online publication date: 23-Aug-2024
https://doi.org/10.3390/computers13090215
Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Gao FDai LZhu JDu MZhang YQiao MXia CWang NLi P(2024)Human-Robot Interactive Creation of Artistic Portrait Drawings2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10611451(11297-11304)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10611451
Show More Cited By

Index Terms

PortraitSketch: face sketching assistance for novices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Painting with Bob: assisted creativity for novices
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Current digital painting tools are primarily targeted at professionals and are often overwhelmingly complex for use by novices. At the same time, simpler tools may not invoke the user creatively, or are limited to plain styles that lack visual ...
The influence of sketch quality on perception of product-idea creativity

This paper explores the relationship between the quality of a sketch and how others perceive the creativity of the idea portrayed by the sketch. In this study, sketch quality is characterized through its line work, perspective, and proportions. Four ...
Artistic sketching with a painterly rendering algorithm
SIGGRAPH '10: ACM SIGGRAPH 2010 Posters

Hand-drawn sketches often depict geometry, colour and texture using loose and roughly drawn lines. Many automated sketching algorithms focus on accurately depicting salient details using pen-and-ink drawings. The approach of Hertzmann et. al. [2000] ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

October 2014

722 pages

ISBN:9781450330695

DOI:10.1145/2642918

General Chair:
Hrvoje Benko
Microsoft Research, USA
,
Program Chairs:
Mira Dontcheva
Adobe, USA
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '14

Sponsor:

UIST '14: The 27th Annual ACM Symposium on User Interface Software and Technology

October 5 - 8, 2014

Hawaii, Honolulu, USA

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
1,074
Total Downloads

Downloads (Last 12 months)68
Downloads (Last 6 weeks)4

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YKong ZFunabiki NHsu C(2024)A Study of a Drawing Exactness Assessment Method Using Localized Normalized Cross-Correlations in a Portrait Drawing Learning Assistant SystemComputers10.3390/computers1309021513:9(215)Online publication date: 23-Aug-2024
https://doi.org/10.3390/computers13090215
Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Gao FDai LZhu JDu MZhang YQiao MXia CWang NLi P(2024)Human-Robot Interactive Creation of Artistic Portrait Drawings2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10611451(11297-11304)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10611451
Yang LPang KZhang HSong Y(2024)Annotation-Free Human Sketch Quality AssessmentInternational Journal of Computer Vision10.1007/s11263-024-02001-1132:8(2743-2764)Online publication date: 17-Feb-2024
https://doi.org/10.1007/s11263-024-02001-1
Chung JAdar E(2023)PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like InteractionsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606777(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606777
Chung JAdar E(2023)Artinter: AI-powered Boundary Objects for Commissioning Visual ArtsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595961(1997-2018)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595961
Pourjafarian NMjaku FKoelle MSchmitz MBorchers JSteimle J(2023)Handheld Tools Unleashed: Mixed-Initiative Physical Sketching with a Robotic PrinterProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580691(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580691
Chen YKwan KFu H(2023)Autocompletion of repetitive stroking with image guidanceComputational Visual Media10.1007/s41095-022-0288-29:3(581-596)Online publication date: 8-Mar-2023
https://doi.org/10.1007/s41095-022-0288-2
Liu FDeng XSong JLai YLiu YWang HMa CQin SWang H(2022)SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch CompositionACM Transactions on Interactive Intelligent Systems10.1145/354395612:3(1-26)Online publication date: 26-Jul-2022
https://dl.acm.org/doi/10.1145/3543956
Pourjafarian NKoelle MMjaku FStrohmeier PSteimle J(2022)Print-A-Sketch: A Handheld Printer for Physical Sketching of Circuits and Sensors on Everyday SurfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502074(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502074
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents