Abstract
Automatic facial expression recognition is a research topic with interesting applications in the field of human-computer interaction, psychology and product marketing. The classification accuracy for an automatic system which uses static images as input is however largely limited by the image quality, lighting conditions and the orientation of the depicted face. These problems can be partially overcome by using a holistic model based approach called the Active Appearance Model. A system will be described that can classify expressions from one of the emotional categories joy, anger, sadness, surprise, fear and disgust with remarkable accuracy. It is also able to detect smaller, local facial features based on minimal muscular movements described by the Facial Action Coding System (FACS). Finally, we show how the system can be used for expression analysis and synthesis.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1995)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co. (1999)
Cohn, J.F., Kanade, T.: Cohn-Kanade AU-Coded Facial Expression Database. Pittsburgh University (1999)
Cootes, T., Taylor, C.: Statistical models of appearance for computer vision. Technical report, University of Manchester, Wolfson Image Analysis Unit, Imaging Science and Biomedical Engineering (2000)
Ekman, P.: Universal facial expressions of emotion. California Mental Health Research Digest 8, 151–158 (1970)
Ekman, P., Davidson, R.J.: The Nature of Emotion - Fundamental Questions. Oxford University Press, New York (1994)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Ekman, P., Friesen, W.V., Ellsworth, P.: Emotion in the Human Face. Pergamon Press, Oxford (1972)
Ekman, P., Friesen, W.V., Hager, J.C.: The Facial Action Coding System. Weidenfeld & Nicolson, London (2002)
Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recognition 36(1), 259–275 (2003)
Frijda, N.: The Emotions. Cambridge University Press & Editions de la Maison des Sciences de l’Homme, Cambridge (1986)
Hager, J., Ekman, P.: The essential behavioral science of the face and gesture that computer scientists need to know. In: Proceedings of the International Workshop on Automatic Face and Gesture Recognition, pp. 7–11 (1995)
Jackson, J.E.: A User’s Guide to Principal Components. John Wiley and Sons, Chichester (1991)
Lebert, E.: Facial expression classification. Experiment report, Sentient Machine Research, Amsterdam, the Netherlands (1997)
Lundqvist, D., Flykt, A., Öhman, A.: The Karolinska Directed Emotional Faces - KDEF. CD ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet (1998)
Nieber, M.: Global structure of the ActiveModelLib. Software architecture description, Vicar Vision BV, Amsterdam, the Netherlands (2003)
Pantic, M.: Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1424–1445 (2000)
Russell, J.A., Fernandez-Dols, J.M. (eds.): The Psychology of Facial Expression. Cambridge University Press, Cambridge (1997)
Shewchuk, J.R.: Triangle: engineering a 2D quality mesh generator and Delaunay triangulator. In: Applied Computational Geometry, FCRC 1996 Workshop, pp. 203–222 (1996)
Sung, K.K., Poggio, T.: Example-based learning for view-based human face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(1), 39–51 (1998)
Van Kuilenburg, H.: Expressions exposed: Model based methods for expression analysis. Master’s thesis, Department of Philosophy, Utrecht University, The Netherlands (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
van Kuilenburg, H., Wiering, M., den Uyl, M. (2005). A Model Based Method for Automatic Facial Expression Recognition. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds) Machine Learning: ECML 2005. ECML 2005. Lecture Notes in Computer Science(), vol 3720. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564096_22
Download citation
DOI: https://doi.org/10.1007/11564096_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29243-2
Online ISBN: 978-3-540-31692-3
eBook Packages: Computer ScienceComputer Science (R0)