Person-Independent Monocular Tracking of Face and Facial Actions with Multilinear Models
Pages 58 - 70
Abstract
In tracking face and facial actions of unknown people, it is essential to take into account two components of facial shape variations: shape variation between people and variation caused by different facial actions such as facial expressions. This paper presents a monocular method of tracking faces and facial actions using a multilinear face model that treats interpersonal and intrapersonal shape variations separately. We created this method using a multilinear face model by integrating two different frameworks: particle filter-based tracking for time-dependent facial action and pose estimation and incremental bundle adjustment for person-dependent shape estimation. This unique combination together with multilinear face models is the key to tracking faces and facial actions of arbitrary people in real time with no pre-learned individual face models. Experiments using real video sequences demonstrate the effectiveness of our method.
References
[1]
Gokturk S.B., Bouguet J.Y., and Grzeszczuk R. A data-driven model for monocular face tracking Proc. IEEE Int. Conf. Computer Vision 2001 Los Alamitos IEEE Computer Society Press 701-708
[2]
Munoz E., Buenaposada J.M., and Baumela L. Efficient model-based 3d tracking of deformable objects Proc. IEEE Int. Conf. Computer Vision 2005 Los Alamitos IEEE Computer Society Press 877-882
[3]
Oka K. and Sato Y. Zhao W., Gong S., and Tang X. Real-time modeling of face deformation for 3-d head pose estimation Analysis and Modelling of Faces and Gestures 2005 Heidelberg Springer 308-320
[4]
Xiao J., Baker S., Matthews I., and Kanade T. Real-time combined 2d+3d active appearance models Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition 2004 Los Alamitos IEEE Computer Society Press 535-542
[5]
Zhu Z. and Ji Q. Robust real-time face pose and facial expression recovery Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition 2006 Los Alamitos IEEE Computer Society Press 681-688
[6]
Gross R., Matthews I., and Baker S. Generic vs. person specific active appearance models Image and Vision Computing 2005 23 11 1080-1093
[7]
Zhu J., Hoi S.C.H., and Lyu M.R. Leonardis A., Bischof H., and Pinz A. Real-time non-rigid shape recovery via active appearance models for augmented reality Computer Vision – ECCV 2006 2006 Heidelberg Springer 186-197
[8]
Dornaika F. and Davoine F. On appearance based face and facial action tracking IEEE transactions on circuits and systems for video technology 2006 16 9 1107-1124
[9]
Vlasic D., Brand M., Pfister H., and Popovic J. Face transfer with multilinear models ACM Transactions on Graphics (Proc. ACM SIGGRAPH 2005) 2005 New York ACM Press 426-433
[10]
DeCarlo D. and Metaxas D. Adjusting shape parameters using model-based optical flow residuals IEEE Trans. Pattern Analysis and Machine Intelligence 2002 24 6 814-823
[11]
Xin L., Wang Q., Tao J., Tang X., Tan T., and Shum H. Automatic 3d face modeling from video Proc. IEEE Int. Conf. Computer Vision 2005 Los Alamitos IEEE Computer Society Press 1193-1199
[12]
Vacchetti L., Lepetit V., and Fua P. Stable real-time 3d tracking using online and offline information IEEE Trans. Pattern Analysis and Machine Intelligence 2004 26 10 1380-1384
[13]
Del Bue A., Smeraldi F., Agapito L., and Mary Q. Non-rigid structure from motion using non-parametric tracking and non-linear optimization Proc. IEEE Workshop on Articulated and Non-Rigid Motion 2004 Los Alamitos IEEE Computer Society Press
[14]
Zhang Z. and Shan Y. Incremental motion estimation through modified bundle adjustment Proc. IEEE Int. Conf. Image Processing 2003 Los Alamitos IEEE Computer Society Press 343-346
[15]
Lourakis, M.I.A.: levmar: Levenberg-marquardt nonlinear least squares algorithms in C/C++ (2004), http://www.ics.forth.gr/~lourakis/levmar/
Index Terms
- Person-Independent Monocular Tracking of Face and Facial Actions with Multilinear Models
Index terms have been assigned to the content through auto-classification.
Recommendations
Person-independent monocular tracking of face and facial actions with multilinear models
AMFG'07: Proceedings of the 3rd international conference on Analysis and modeling of faces and gesturesIn tracking face and facial actions of unknown people, it is essential to take into account two components of facial shape variations: shape variation between people and variation caused by different facial actions such as facial expressions. This paper ...
Model-Based Face Tracking for View-Independent Facial Expression Recognition
FGR '02: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture RecognitionFacial expression recognition is necessary for designing any realistic human-machine interfaces. Previous published facial expression recognition systems achieve good recognition rates, but most of them perform well only when the user faces the camera ...
Expression-invariant face recognition by facial expression transformations
In this paper, we present a method of expression-invariant face recognition that transforms input face image with an arbitrary expression into its corresponding neutral facial expression image. When a new face image with an arbitrary expression is ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2007
248 pages
ISBN:978-3-540-75689-7
DOI:10.1007/978-3-540-75690-3
- Editors:
- S. Kevin Zhou,
- Wenyi Zhao,
- Xiaoou Tang,
- Shaogang Gong
© Springer-Verlag Berlin Heidelberg 2007.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 15 March 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in