Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

Mean value coordinates–based caricature and expression synthesis

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

We present a novel method for caricature synthesis based on mean value coordinates (MVC). Our method can be applied to any single frontal face image to learn a specified caricature face pair for frontal and 3D caricature synthesis. This technique only requires one or a small number of exemplar pairs and a natural frontal face image training set, while the system can transfer the style of the exemplar pair across individuals. Further exaggeration can be fulfilled in a controllable way. Our method is further applied to facial expression transfer, interpolation, and exaggeration, which are applications of expression editing. Additionally, we have extended our approach to 3D caricature synthesis based on the 3D version of MVC. With experiments we demonstrate that the transferred expressions are credible and the resulting caricatures can be characterized and recognized.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Hormann K., Floater M.S.: Mean value coordinates for arbitrary planar polygons. ACM Trans. Graph. 25(4), 1424–1441 (2006)

    Article  Google Scholar 

  2. Ju, T., Schaefer, S., Warren, J.: Mean value coordinates for closed triangular meshes. In: Proceedings of ACM SIGGRAPH, pp. 561–566 (2005)

  3. Akleman, E.: Making caricature with morphing. In: Proceedings of ACM SIGGRPH, Los Angeles, California, pp. 145–145 (1997)

  4. Akleman, E., Palmer, J., Logan, R.: Making extreme caricatures with a new interactive 2D deformation technique with simplicial complexes. In: Proceddings of the 3rd International Conference on Visual Computing, Mexico, pp. 165–170 (2000)

  5. Chen, H., Zheng, N.N., Liang, L. et al.: PicToon: a personalized image-based cartoon system. In: Proceedings of ACM International Conference on Multimedia, Juan-les-Pins, France, pp. 171–178 (2002)

  6. Gooch B., Reinhard E., Gooch A.: Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)

    Article  Google Scholar 

  7. Brennan S.E.: Caricature generator: the dynamic exaggeration of faces by computer. Leonardo 18(3), 170–178 (1985)

    Article  MathSciNet  Google Scholar 

  8. Koshimizu, H., Tominaga, M., Fujiwara, T., Murakami, K.: On KANSEI facial processing for computerized facial caricaturing system Picasso. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, pp. 294–299 (1999)

  9. Mo, Z.Y., Lewis, J.P., Neumann, U.: Improved automatic caricature by feature normalization and exaggeration. In: Proceedings of ACM SIGGRAPH 2004 Sketches. pp. 57–57, Los Angeles, California (2004)

  10. Chiang, P.Y., Liao, W.H., Li, T.Y.: Automatic caricature generation by analyzing facial features. In: Proceedings of Asia Conference on Computer Vision, Korea (2004)

  11. Shet, R.N., Lai, K.H., et al.: Use of neural networks in automatic caricature generation: an approach based on drawing style capture. In: Proceedings of the second edition of the Iberian Conference on Pattern Recognition and Image Analysis, pp. 343–351. Portugal (2005)

  12. Tseng, C.C., Lien, J.J.: Synthesis of exaggerative caricature with inter and intra correlations. In: Proceedings of Asian Conference on Computer Vision, pp. 314–323. Tokyo, Japan (2007)

  13. Chen, H., Liu, Z., Rose, C. et al.: Example-based composite sketching of human portraits. In: Proceedings of International Symposium on Non-Photorealistic Animation and Rendering, pp. 95–102. New York (2004)

  14. Chen, H., Xu, Y.Q., Shum, H. et al.: Example-based facial sketch generation with non-parametric sampling. In: Proceedings of the 8th International Conference on Computer Vision, pp. 433–438. Vancouver, Canada (2001)

  15. Liang, L., Chen, H., Xu, Y.Q., Shum, H.Y.: Example-based caricature generation with exaggeration. In: Proceedings of 10th Pacific Conference on Computer Graphics and Applications, pp. 386–393. China (2002)

  16. Lyons M., Budynek J., Akamatsu S.: Automatic classification of single facial images. In: IEEE Trans. Pattern Anal. Mach. Intell. 21(12), 1357–1362 (1999)

    Article  Google Scholar 

  17. Xu G.Z., Kaneko M., Kurematsu A.: Synthesis of facial caricature using eigenspaces. IEICE Trans. Inf. Syst.(Japanese Edition) J84-D-II(7), 1279–1288 (2001)

    Google Scholar 

  18. Blanz, V., Basso, C. et al.: Reanimating faces in images and video. In: Brunet, P., Fellner, D. (eds.) Proceedings of Eurographics, Granada, Spain, vol. 22, No. 3, pp. 641–650 (2003)

  19. Zhang Q., Liu Z., Guo B. et al.: Geometry-driven photorealistic facial expression synthesis. In: IEEE Trans. Vis. Comput. Graph. 12(1), 48–60 (2006)

    Article  Google Scholar 

  20. Fujiwara, T., Koshimizu, H., Fujimura, K. et al.: 3D modeling system of human face and full 3D facial caricaturing. In: Proceedings of IEEE 7th International Conference on Virtual Systems and Multimedia, 25–27 Oct (2001)

  21. Xingyu, G., Yiqiang, C., Junfa, L. et al.: Personalized 3D caricature generation based on PCA subspace. In: Proceedings of 9th Pacific Rim Conference on Multimedia, Taiwan, Dec (2008)

  22. Akleman, E.: Modeling expressive 3D faces. In: Proceedings of ACM SIGGRAPH’2004 (Siggraph Sketch), Los Angeles, California, p. 61. July (2004)

  23. Lenn, R.: How to Draw Caricature, pp. 61–90. Contemporary Books (1984)

  24. Arad N., Dyn N. et al.: Image warping by radial basis functions: applications to facial expressions. CVGIP: Graph. Models Image Process. 56(2), 161–172 (1994)

    Article  Google Scholar 

  25. Dubuisson, M.P., Jain, A.K.: A modified Hausdorff distance for object matching. In: Proceedings of International Conference on Pattern Recognition, pp. 566–568. Jerusalem, Israel (1994)

  26. Davies, R.H., Twining, C.J., Cootes, T.F. et al.: 3D statistical shape models using direct optimisation of description length. In: Proceedings of European Conference on Computer Vision, vol. 3, pp. 3–20 (2002)

  27. Floater M.S., Hormann K.: Surface parameterization: a tutorial and survey. In: Dodgson, N.A., Floater, M.S., Sabin, M.A. (eds.) Advances in Multiresolution for Geometric Modelling, pp. 157–186. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  28. Maccracken, R., Joy, K.I.: Free-form deformations with lattices of arbitrary topology. In: Proceedings of ACM SIGGRAPH, pp. 181–188 (1996)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongchuan Yu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yu, H., Zhang, J.J. Mean value coordinates–based caricature and expression synthesis. SIViP 7, 899–910 (2013). https://doi.org/10.1007/s11760-011-0279-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-011-0279-8

Keywords

Navigation