Abstract
We propose a factorization structure from motion (SfM) framework which employs 3D active shape constraints for a 3D face model application. Two types of shape model, individual shape models and a generic model, are used to approximate non-linear manifold variation. When the 3D shape models are trained, they help the SfM algorithm to reconstruct the 3D face structure under noisy observation (tracking) circumstances. By minimizing two sets of errors, the reconstruction error generated by the linear transform of the shape models and projection error obtained by re-projecting the 3D shape to 2D positions, the 3D face shapes can be recovered optimally. Experimental results show that this algorithm accurately reconstructs the 3D shape of familiar and non-familiar faces from video sequences under circumstances of imperfect face tracking or noisy observations.
This research was support by EPSRC grants EP/D056942 and EP/D054818 to N. P. Costen, T. F. Cootes, K. Lander and C. J. Taylor.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Computer Graphics. In: Proceedings of SIGGRAPH, pp. 187–194 (1999)
Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D face scans to 3D models. IEEE Transations on Pattern Analysis and Machine Intelligence 28, 31–43 (2006)
Zhang, Z., Deriche, R., Faugeras, O., Luong, Q.T.: A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artifical Intelligence Jounal 78, 87–119 (1995)
Hartley, R.: Lines and points in three views - a unified approach. In: Proceedings of the ARPA IU Workshop, vol. 2, pp. 1009–1016 (1994)
Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision 9, 137–154 (1992)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3d shape from image streams. In: Proceedings of the IEEE International Conference on Computer Vision & Pattern Recognition, vol. 2, pp. 690–696 (2000)
Torresani, L., Hertzmann, A., Bregler, C.: Learning non-rigid 3D shape from 2D motion. In: Proceedings of Advances in Neural Information Processing Systems, pp. 1555–1562 (2003)
Xiao, J., Chai, J.X., Kanade, T.: A closed-form solution to non-rigid shape and motion recovery. International Journal of Computer Vision 67, 233–246 (2006)
Cootes, T.F., Taylor, C.J.: Active shape models. In: Proceedings of the British Machine Vision Conference, pp. 266–275 (1992)
Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Transations on Pattern Analysis and Machine Intelligence 23, 681–685 (2001)
Gross, R., Matthews, I., Baker, S.: Generic vs. person specific active appearance models. Image and Vision Computing 23, 1080–1093 (2005)
Costen, N.P., Brown, M., Akamatsu, S.: Sparse models for gender classification. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp. 201–206 (2004)
Costen, N.P., Cootes, T.F., Taylor, C.J.: Compensating for ensemble-specific effects when building facial models. Image and Vision Computing 20, 673–682 (2002)
Torres, L., Vila, J.: Automatic face recognition for video indexing applications. Pattern Recognition 35, 615–625 (2002)
Liu, X., Chen, T., Kumar, B.V.K.V.: Face authentication for multiple subjects using eigenflow. Pattern Recognition 36, 313–328 (2003)
Xiao, J., Baker, S., Matthews, I., Kanade, T.: Real-time combined 2d+3d active appearance models. In: Proceedings of the IEEE International Conference on Computer Vision & Pattern Recognition, vol. 2, pp. 535–542 (2004)
Ross, T.: Fuzzy Logic with Engineering Applications. John Wiley & Sons Ltd, Chichester (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fang, H., Costen, N.P. (2007). 3D Face Reconstruction Under Imperfect Tracking Circumstances Using Shape Model Constraints. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2007. Lecture Notes in Computer Science, vol 4842. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76856-2_51
Download citation
DOI: https://doi.org/10.1007/978-3-540-76856-2_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76855-5
Online ISBN: 978-3-540-76856-2
eBook Packages: Computer ScienceComputer Science (R0)