Abstract
We present a novel method for caricature synthesis based on mean value coordinates (MVC). Our method can be applied to any single frontal face image to learn a specified caricature face pair for frontal and 3D caricature synthesis. This technique only requires one or a small number of exemplar pairs and a natural frontal face image training set, while the system can transfer the style of the exemplar pair across individuals. Further exaggeration can be fulfilled in a controllable way. Our method is further applied to facial expression transfer, interpolation, and exaggeration, which are applications of expression editing. Additionally, we have extended our approach to 3D caricature synthesis based on the 3D version of MVC. With experiments we demonstrate that the transferred expressions are credible and the resulting caricatures can be characterized and recognized.
Similar content being viewed by others
References
Hormann K., Floater M.S.: Mean value coordinates for arbitrary planar polygons. ACM Trans. Graph. 25(4), 1424–1441 (2006)
Ju, T., Schaefer, S., Warren, J.: Mean value coordinates for closed triangular meshes. In: Proceedings of ACM SIGGRAPH, pp. 561–566 (2005)
Akleman, E.: Making caricature with morphing. In: Proceedings of ACM SIGGRPH, Los Angeles, California, pp. 145–145 (1997)
Akleman, E., Palmer, J., Logan, R.: Making extreme caricatures with a new interactive 2D deformation technique with simplicial complexes. In: Proceddings of the 3rd International Conference on Visual Computing, Mexico, pp. 165–170 (2000)
Chen, H., Zheng, N.N., Liang, L. et al.: PicToon: a personalized image-based cartoon system. In: Proceedings of ACM International Conference on Multimedia, Juan-les-Pins, France, pp. 171–178 (2002)
Gooch B., Reinhard E., Gooch A.: Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)
Brennan S.E.: Caricature generator: the dynamic exaggeration of faces by computer. Leonardo 18(3), 170–178 (1985)
Koshimizu, H., Tominaga, M., Fujiwara, T., Murakami, K.: On KANSEI facial processing for computerized facial caricaturing system Picasso. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, pp. 294–299 (1999)
Mo, Z.Y., Lewis, J.P., Neumann, U.: Improved automatic caricature by feature normalization and exaggeration. In: Proceedings of ACM SIGGRAPH 2004 Sketches. pp. 57–57, Los Angeles, California (2004)
Chiang, P.Y., Liao, W.H., Li, T.Y.: Automatic caricature generation by analyzing facial features. In: Proceedings of Asia Conference on Computer Vision, Korea (2004)
Shet, R.N., Lai, K.H., et al.: Use of neural networks in automatic caricature generation: an approach based on drawing style capture. In: Proceedings of the second edition of the Iberian Conference on Pattern Recognition and Image Analysis, pp. 343–351. Portugal (2005)
Tseng, C.C., Lien, J.J.: Synthesis of exaggerative caricature with inter and intra correlations. In: Proceedings of Asian Conference on Computer Vision, pp. 314–323. Tokyo, Japan (2007)
Chen, H., Liu, Z., Rose, C. et al.: Example-based composite sketching of human portraits. In: Proceedings of International Symposium on Non-Photorealistic Animation and Rendering, pp. 95–102. New York (2004)
Chen, H., Xu, Y.Q., Shum, H. et al.: Example-based facial sketch generation with non-parametric sampling. In: Proceedings of the 8th International Conference on Computer Vision, pp. 433–438. Vancouver, Canada (2001)
Liang, L., Chen, H., Xu, Y.Q., Shum, H.Y.: Example-based caricature generation with exaggeration. In: Proceedings of 10th Pacific Conference on Computer Graphics and Applications, pp. 386–393. China (2002)
Lyons M., Budynek J., Akamatsu S.: Automatic classification of single facial images. In: IEEE Trans. Pattern Anal. Mach. Intell. 21(12), 1357–1362 (1999)
Xu G.Z., Kaneko M., Kurematsu A.: Synthesis of facial caricature using eigenspaces. IEICE Trans. Inf. Syst.(Japanese Edition) J84-D-II(7), 1279–1288 (2001)
Blanz, V., Basso, C. et al.: Reanimating faces in images and video. In: Brunet, P., Fellner, D. (eds.) Proceedings of Eurographics, Granada, Spain, vol. 22, No. 3, pp. 641–650 (2003)
Zhang Q., Liu Z., Guo B. et al.: Geometry-driven photorealistic facial expression synthesis. In: IEEE Trans. Vis. Comput. Graph. 12(1), 48–60 (2006)
Fujiwara, T., Koshimizu, H., Fujimura, K. et al.: 3D modeling system of human face and full 3D facial caricaturing. In: Proceedings of IEEE 7th International Conference on Virtual Systems and Multimedia, 25–27 Oct (2001)
Xingyu, G., Yiqiang, C., Junfa, L. et al.: Personalized 3D caricature generation based on PCA subspace. In: Proceedings of 9th Pacific Rim Conference on Multimedia, Taiwan, Dec (2008)
Akleman, E.: Modeling expressive 3D faces. In: Proceedings of ACM SIGGRAPH’2004 (Siggraph Sketch), Los Angeles, California, p. 61. July (2004)
Lenn, R.: How to Draw Caricature, pp. 61–90. Contemporary Books (1984)
Arad N., Dyn N. et al.: Image warping by radial basis functions: applications to facial expressions. CVGIP: Graph. Models Image Process. 56(2), 161–172 (1994)
Dubuisson, M.P., Jain, A.K.: A modified Hausdorff distance for object matching. In: Proceedings of International Conference on Pattern Recognition, pp. 566–568. Jerusalem, Israel (1994)
Davies, R.H., Twining, C.J., Cootes, T.F. et al.: 3D statistical shape models using direct optimisation of description length. In: Proceedings of European Conference on Computer Vision, vol. 3, pp. 3–20 (2002)
Floater M.S., Hormann K.: Surface parameterization: a tutorial and survey. In: Dodgson, N.A., Floater, M.S., Sabin, M.A. (eds.) Advances in Multiresolution for Geometric Modelling, pp. 157–186. Springer, Heidelberg (2005)
Maccracken, R., Joy, K.I.: Free-form deformations with lattices of arbitrary topology. In: Proceedings of ACM SIGGRAPH, pp. 181–188 (1996)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yu, H., Zhang, J.J. Mean value coordinates–based caricature and expression synthesis. SIViP 7, 899–910 (2013). https://doi.org/10.1007/s11760-011-0279-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-011-0279-8