research-article

Free access

Life-sketch: a framework for sketch-based modelling and animation of 3D objects

Authors:

Burkhard C. WünscheAuthors Info & Claims

AUIC '10: Proceedings of the Eleventh Australasian Conference on User Interface - Volume 106

Pages 61 - 70

Published: 01 January 2010 Publication History

Abstract

The design and animation of digital 3D models is an essential task for many applications in science, engineering, education, medicine and arts. In many instances only an approximate representation is required and a simple and intuitive modelling and animation process, suitable for untrained users, is more important than realism and extensive features. Sketch-based modelling has been shown to be a suitable interface because the underlying pen-and-paper metaphor is intuitive and effective.

In this paper we present LifeSketch, a framework for sketched-based modelling and animation. Three-dimensional models are created with a variation of the popular "Teddy" algorithm. The models are analysed and skeletons with joints are extracted fully automatically. The surface mesh is bound to the curved skeletons using skinning techniques and the resulting model can be animated using skeletal animation methods.

The results of our evaluation and user study suggest that modelling and animation tasks are considerable more efficient than with traditional tools. The learning curve is very flat and a half page document was sufficient to familiarise users with the tools functionality. Users were satisfied with the automatically extracted joints, but some users struggled selecting the appropriate rotation axes and angles for animating the resulting 3D objects. A more intuitive, preferable automatic or sketch-based approach for animations is needed. Overall users were satisfied with the modelling capabilities of the tool, found most of its functionality natural and intuitive, and they enjoyed using it.

References

[1]

}}Arcila, R., Levet, F. & Schlick, C. (2008), Thor: Sketch-based 3d modeling by skeletons, in 'Smart Graphics', pp. 232--238.

Digital Library

[2]

}}Baran, I. & Popovi&cacute;ć, J. (2007), 'Automatic rigging and animation of 3d characters', ACM Trans. Graph. 26(3), 72. http://www.mit.edu/~ibaran/autorig/.

Digital Library

[3]

}}Chen, X., Neubert, B., Xu, Y.-Q., Deussen, O. & Kang, S. B. (2008), Sketch-based tree modeling using markov random field, in 'ACM SIGGRAPH Asia 2008 papers', ACM, pp. 1--9.

Digital Library

[4]

}}Cheutet, V., Catalano, C. E., Pernot, J.-P., Falcidieno, B., Giannini, F. & Leon, J.-C. (2005), '3d sketching for aesthetic design using fully free-form deformation features', Computers & Graphics 29(6), 916--930.

Digital Library

[5]

}}Cootes, T. F., Taylor, C. J., Cooper, D. H. & Graham, J. (1995), 'Active shape models---their training and application', Computer Vision and Image Understanding 61(1), 38--59. http://www.isbe.man.ac.uk/~bim/Papers/cviu95.pdf.

Digital Library

[6]

}}Davis, J., Agrawala, M., Chuang, E., Popović, Z. & Salesin, D. (2003), A sketching interface for articulated figure animation, in 'SCA '03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation', Eurographics Association, pp. 320--328.

Digital Library

[7]

}}de Araújo, B., Jorge, J., Sousa, M. C., Samavati, F. & Wyvill, B. (2004), MIBlob: a tool for medical visualization and modelling using sketches, in 'SIGGRAPH '04: Posters', ACM Press, p. 107.

Digital Library

[8]

}}Eggli, L., Ching-Yao, H., Bruderlin, B. D. & Elber, G. (1997), 'Inferring 3d models from freehand sketches and constraints', Computer-Aided Design 29(2), 101--112.

[9]

}}Gain, J., Marais, P. & Strasser, W. (2009), Terrain sketching, in 'I3D '09: Proceedings of the 2009 symposium on Interactive 3D graphics and games', ACM, pp. 31--38. http://people.cs.uct.ac.za/~jgain/publications/terrsketch.pdf.

Digital Library

[10]

}}Google (2009), 'Google sketchup homepage'. http://sketchup.google.com/.

[11]

}}Grimm, C. & Hughes, J. (1998), Implicit generalized cylinders using profile curves, in 'Implicit Surfaces', pp. 33--41. Creating sweep surfaces using sketching.

[12]

}}Gross, M. D. & Do, E. Y.-L. (1996), Ambiguous intentions: a paper-like interface for creative design, in 'UIST '96: Proceedings of the 9th annual ACM symposium on User interface software and technology', ACM, pp. 183--192.

Digital Library

[13]

}}Hart, J. (1999), The Art of Storyboard: Storyboarding for Film, TV, and Animation, Focal Press.

[14]

}}Hua, J. & Qin, H. (2003), Free-form deformations via sketching and manipulating scalar fields, in 'Proceedings of the 8th Symposium on Solid modeling and Applications (SM 03)', ACM Press, pp. 328--333.

Digital Library

[15]

}}Igarashi, T. & Hughes, J. F. (2003), Smooth meshes for sketch-based freeform modeling, in 'I3D '03: Proceedings of the 2003 symposium on Interactive 3D graphics', ACM, pp. 139--142. http://www-ui.is.s.u-tokyo.ac.jp/~takeo/java/smoothteddy/index.html.

Digital Library

[16]

}}Igarashi, T., Matsuoka, S., Kawachiya, S. & Tanaka, H. (1997), Interactive beautification: a technique for rapid geometric design, in 'Proceedings of the Symposium on User Interface Software and Technology', pp. 105--114.

Digital Library

[17]

}}Igarashi, T., Moscovich, T. & Hughes, J. F. (2005a), 'As-rigid-as-possible shape manipulation', ACM Trans. Graph. 24(3), 1134--1141.

Digital Library

[18]

}}Igarashi, T., Moscovich, T. & Hughes, J. F. (2005b), Spatial keyframing for performance-driven animation, in 'SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation', ACM, pp. 107--115. http://www-ui.is.s.u-tokyo.ac.jp/~takeo/research/squirrel/index.html.

Digital Library

[19]

}}Igarashia, T., Matsuoka, S. & Tanaka, H. (1999), Teddy: a sketching interface for 3d freeform design, in 'Proceedings of SIGGRAPH '99', ACM Press, pp. 409--416.

Digital Library

[20]

}}Ijiri, T., Ashihara, T., Yamaguchi, T., Takayama, K., Igarashi, T., Shimada, T., Namba, T., Haraguchi, R. & Nakazawa, K. (2008), 'A procedural method for modeling the purkinje fibers of the heart', The Journal of Physiological Science 58(7), 481--486.

[21]

}}Ijiri, T., Owada, S. & Igarashi, T. (2006), The sketch l-system: Global control of tree modeling using free-form strokes, in 'Proceedings of Smart Graphics 2006', pp. 138--146. http://www-ui.is.s.u-tokyo.ac.jp/~ijiri/SketchLSystem/index.html.

[22]

}}Ijiri, T., Owada, S., Okabe, M. & Igarashi, T. (2005), 'Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints', ACM Trans. Graph. 24(3), 720--726. http://www-ui.is.s.u-tokyo.ac.jp/~ijiri/FdAndIfs/index.html.

Digital Library

[23]

}}Kara, L. B. & Shimada, K. (2007), 'Sketch-based 3d-shape creation for industrial styling design', IEEE Computer Graphics and Applications 27(1), 60--71.

Digital Library

[24]

}}Karpenko, O. A. & Hughes, J. F. (2006), 'Smoothsketch: 3d free-form shapes from complex sketches', ACM Transactions on Graphics 25(3), 589--598.

Digital Library

[25]

}}Karpenko, O., Hughes, J. & Raskar, R. (2002), 'Free-form sketching with variational implicit surfaces', Computer Graphics Forum 21(3), 585--594. http://www.merl.com/papers/docs/TR2002-27.pdf.

[26]

}}Landay, J. A. & Myers, B. A. (2001), 'Sketching interfaces: Toward more human interface design', Computer 34(3), 56--64. http://www.eecs.berkeley.edu/~landay/research/publications/silk-ieee-published.pdf.

Digital Library

[27]

}}Lepetit, V. & Fua, P. (2005), 'Monocular model-based 3d tracking of rigid objects: A survey', Foundations and Trends in Computer Graphics and Vision 1(1), 1--89.

Digital Library

[28]

}}Levet, F. & Granier, X. (2007), Improved skeleton extraction and surface generation for sketch-based modeling, in 'GI '07: Proceedings of Graphics Interface 2007', ACM, pp. 27--33.

Digital Library

[29]

}}Lewis, J. P., Cordner, M. & Fong, N. (2000), Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, in 'SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques', ACM Press/Addison-Wesley Publishing Co., pp. 165--172.

Digital Library

[30]

}}Mao, C., Qin, S. F. & Wright, D. (2007), Sketch-based virtual human modelling and animation, in 'SG '07: Proceedings of the 8th international symposium on Smart Graphics', Springer-Verlag, pp. 220--223.

Digital Library

[31]

}}Mao, C., Qin, S. F. & Wright, D. K. (2006), Sketching-out virtual humans: from 2d storyboarding to immediate 3d character animation, in 'ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology', ACM, p. 61.

Digital Library

[32]

}}Marr, D. & Nishihara, H. K. (1978), Representation and recognition of the spatial organization of three-dimensional images, in 'Proceedings of the Royal Society of London, Series B', Vol. 200, pp. 269--294.

[33]

}}McCord, G., Wünsche, B. C., Plimmer, B., Gilbert, G. & Hirsch, C. (2008), A pen and paper metaphor for orchid modeling, in 'Proceedings of the 3rd International Conference on Computer Graphics Theory and Applications (GRAPP 2008)', pp. 119--124.

[34]

}}Mitani, J., Suzuki, H. & Kimura, F. (2002), '3d sketch: sketch-based model reconstruction and rendering', pp. 85--98.

[35]

}}Nealen, A., Igarashi, T., Sorkine, O. & Alexa, M. (2007), Fibermesh: designing freeform surfaces with 3d curves, in 'SIGGRAPH '07: ACM SIGGRAPH 2007 papers', ACM, p. 41.

Digital Library

[36]

}}Olsen, L., Samavati, F. F., Sousa, M. C. & Jorge, J. A. (2009), 'Technical section: Sketch-based modeling: A survey', Computers & Graphics 33(1), 85--103. http://pages.cpsc.ucalgary.ca/~olsenl/wiki/uploads/Papers/CnGsurvey.pdf.

Digital Library

[37]

}}Sakamoto, D., Honda, K., Inami, M. & Igarashi, T. (2009), Sketch and run: a stroke-based interface for home robots, in 'CHI '09: Proceedings of the 27th international conference on Human factors in computing systems', ACM, pp. 197--200.

Digital Library

[38]

}}Sanders, M., Lobb, R. & Riddle, P. (2003), Evolving controllers for virtual creature locomotion, in 'GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia', ACM, pp. 255--256.

Digital Library

[39]

}}Schmidt, R., Wyvill, B., Sousa, M. C. & Jorge, J. A. (2006), Shapeshop: sketch-based solid modeling with blobtrees, in 'SIGGRAPH '06: ACM SIGGRAPH 2006 Courses', ACM, p. 14.

Digital Library

[40]

}}Sezgin, T. M., Stahovich, T. & Davis, R. (2001), Sketch based interfaces: Early processing for sketch understanding, in 'Proceedings of the Workshop for Perceptive User Interfaces (PUI 01)', ACM Press, pp. 1--8.

Digital Library

[41]

}}Sims, K. (1994), Evolving virtual creatures, in 'SIGGRAPH '94: Proceedings of the 21st annual conference on Computer graphics and interactive techniques', ACM, pp. 15--22.

Digital Library

[42]

}}Smith, R. (2007), 'Open Dynamics Engine home page'. http://www.ode.org.

[43]

}}Steger, E. (2004), Sketch-based animation language, Technical report, Department of Computer Science, University of Toronto. URL: http://www.cs.toronto.edu/~esteger/sketchlang/index.html.

[44]

}}Sugihara, M., Groot, E., Wyvill, B. & Schmidt, R. (2008), A sketch-based method to control deformation in a skeletal implicit surface modeler, in 'Proceedings of the 5th Eurographics Workshop on Sketch-Based Interfaces and Modeling', pp. 65--72.

Digital Library

[45]

}}Takayama, K., Ashihara, T., Ijiri, T., Igarashi, T., Haraguchi, R. & Nakazawa, K. (2008), 'A sketch-based interface for modeling myocardial fiber orientation that considers the layered structure of the ventricles', The Journal of Physiological Sciences 58(7), 487--492.

[46]

}}Thorne, M., Burke, D. & van de Panne, M. (2004), 'Motion doodles: an interface for sketching character motion', ACM Trans. Graph. 23(3), 424--431. http://people.cs.ubc.ca/~van/papers/doodle.html.

Digital Library

[47]

}}Turquin, E., Wither, J., Boissieux, L., Cani, M.-P. & Hughes, J. F. (2007), 'A sketch-based interface for clothing virtual characters', IEEE Comput. Graph. Appl. 27(1), 72--81.

Digital Library

[48]

}}Villar, J. R. (2007--2009), 'Typhoonlabs' opengl shading language tutorials'. Typhoonlabs Real Time Technologies {Online} www.opengl.org/sdk/docs/tutorials/TyphoonLabs/.

[49]

}}Wong, Y. Y. (1992), Rough and ready prototypes: lessons from graphic design, in 'CHI '92: Posters and short talks of the 1992 SIGCHI conference on Human factors in computing systems', ACM, pp. 83--84.

Digital Library

[50]

}}Xie, X. S. & Wüünsche, B. C. (2010), 'Efficient contour line labelling for terrain modelling'. {Submitted for publication}.

[51]

}}Yang, R. (2009), Life sketch - a tool for sketch-based modelling and animation, Master's thesis, Department of Computer Science, University of Auckland, Auckland, New Zealand. (to be published).

[52]

}}Zeleznik, R. C., Herndon, K. P. & Hughes, J. F. (1996), SKETCH: An interface for sketching 3d scenes, in 'Proceedings of SIGGRAPH '96', ACM Press, pp. 163--170.

Digital Library

[53]

}}Zimmermann, J., Nealen, A. & Alexa, M. (2008), 'Sketching contours', Computers & Graphics 32(5), 486--499. http://www.cs.rutgers.edu/~nealen/research/sc_preprint.pdf.

Digital Library

Cited By

Zeng YSong ZWünsche B(2014)Towards a 3D sketch-based modelling APIProceedings of the Fifteenth Australasian User Interface Conference - Volume 15010.5555/2667657.2667660(21-28)Online publication date: 20-Jan-2014
https://dl.acm.org/doi/10.5555/2667657.2667660
Guan LWünsche B(2012)An evaluation of a sketch-based model-by-example approach for crowd modellingProceedings of the Thirteenth Australasian User Interface Conference - Volume 12610.5555/2512125.2512134(69-76)Online publication date: 31-Jan-2012
https://dl.acm.org/doi/10.5555/2512125.2512134
Hartmann GWünsche B(2012)A virtual touchscreen with depth recognitionProceedings of the Thirteenth Australasian User Interface Conference - Volume 12610.5555/2512125.2512131(39-48)Online publication date: 31-Jan-2012
https://dl.acm.org/doi/10.5555/2512125.2512131
Show More Cited By

Index Terms

Life-sketch: a framework for sketch-based modelling and animation of 3D objects

Recommendations

Differential blending for expressive sketch-based posing
SCA '13: Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Generating highly expressive and caricatured poses can be difficult in 3D computer animation because artists must interact with characters indirectly through complex character rigs. Furthermore, since caricatured poses often involve large bends and ...
Spherical blend skinning: a real-time deformation of articulated models
I3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and games

Skin deformation based on an underlying skeleton is a common method to animate believable organic models. The most widely used skeletal animation algorithm, linear blend skinning, is also known as skeleton subspace deformation, vertex blending, or ...
A sketch-based articulated figure animation tool
SAICSIT '11: Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment

Animating models using traditional 3D modelling and animation packages is complex and difficult for novice users to use. A sketch-based articulated figure animation tool is introduced that provides users with an intuitive interface to pose and animate ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

AUIC '10: Proceedings of the Eleventh Australasian Conference on User Interface - Volume 106

January 2010

114 pages

ISBN:9781920682873

Editors:
Christof Lutteroth
The University of Auckland
,
Paul Calder
Flinders University

Sponsors

Australian Comp Soc: Australian Computer Society
SAP Research
Queensland University of Technology
CEED
CSIRO ICT Centre
CORE - Computing Research and Education
Macquarie University-Sydney

Publisher

Australian Computer Society, Inc.

Australia

Publication History

Published: 01 January 2010

Author Tags

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 40 of 100 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
717
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)5

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeng YSong ZWünsche B(2014)Towards a 3D sketch-based modelling APIProceedings of the Fifteenth Australasian User Interface Conference - Volume 15010.5555/2667657.2667660(21-28)Online publication date: 20-Jan-2014
https://dl.acm.org/doi/10.5555/2667657.2667660
Guan LWünsche B(2012)An evaluation of a sketch-based model-by-example approach for crowd modellingProceedings of the Thirteenth Australasian User Interface Conference - Volume 12610.5555/2512125.2512134(69-76)Online publication date: 31-Jan-2012
https://dl.acm.org/doi/10.5555/2512125.2512134
Hartmann GWünsche B(2012)A virtual touchscreen with depth recognitionProceedings of the Thirteenth Australasian User Interface Conference - Volume 12610.5555/2512125.2512131(39-48)Online publication date: 31-Jan-2012
https://dl.acm.org/doi/10.5555/2512125.2512131
Borosán PJin MDeCarlo DGingold YNealen A(2012)RigMeshACM Transactions on Graphics10.1145/2366145.236621731:6(1-9)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1145/2366145.2366217
Guan LWünsche B(2011)Sketch-based crowd modellingProceedings of the Twelfth Australasian User Interface Conference - Volume 11710.5555/2460616.2460624(67-76)Online publication date: 17-Jan-2011
https://dl.acm.org/doi/10.5555/2460616.2460624
Wünsche BKeymer DAmor RRyu HChampion E(2010)Sketch, click, plug and playProceedings of the 11th International Conference of the NZ Chapter of the ACM Special Interest Group on Human-Computer Interaction10.1145/1832838.1832845(33-40)Online publication date: 8-Jul-2010
https://dl.acm.org/doi/10.1145/1832838.1832845

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents