Abstract
As an effective technique for feature extraction and pattern classification Fisher linear discriminant (FLD) has been successfully applied in many fields. However, for a task with very high-dimensional data such as face images, conventional FLD technique encounters a fundamental difficulty caused by singular within-class scatter matrix. To avoid the trouble, many improvements on the feature extraction aspect of FLD have been proposed. In contrast, studies on the pattern classification aspect of FLD are quiet few. In this paper, we will focus our attention on the possible improvement on the pattern classification aspect of FLD by presenting a novel linear discriminant criterion called maximum scatter difference (MSD). Theoretical analysis demonstrates that MSD criterion is a generalization of Fisher discriminant criterion, and is the asymptotic form of discriminant criterion: large margin linear projection. The performance of MSD classifier is tested in face recognition. Experiments performed on the ORL, Yale, FERET and AR databases show that MSD classifier can compete with top-performance linear classifiers such as linear support vector machines, and is better than or equivalent to combinations of well known facial feature extraction methods, such as eigenfaces, Fisherfaces, orthogonal complementary space, nullspace, direct linear discriminant analysis, and the nearest neighbor classifier.
Similar content being viewed by others
References
Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley, New York
Belhumeur PN, Hespanha JP, Kriengman DJ (1997) Eigenfaces vs Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720
Fengxi Song, Shuhai Liu, Jingyu Yang (2005) Orthogonalized Fisher discriminant. Pattern Recognit 38(2):311–313
Fengxi Song, David Zhang, Jingyu Yang (2006) A novel dimensionality reduction approach for face recognition. Neurocomputing 69(13–15):1683–1687
Liu K, Cheng YQ, Yang JY (1992) An efficient algorithm for Foley–Sammon optimal set of discriminant vectors by algebraic method. Int J Pattern Recognit Artif Intell 6(5):817–829
Chen L, Liao H, Ko M, Lin J, Yu G (2000) A New LDA-based face recognition system which can solve the small sample size problem. Pattern Recognit 33(10):1713–1726
Hua Yu, Jie Yang (2001) A direct LDA algorithm for high-dimensional data—with application to face recognition. Pattern Recognit 34:2067–2070
Yang J, Zhang D, Yang JY (2003) A generalised K–L expansion method which can deal with small sample size and high-dimensional problems. Pattern Anal Appl 6(1):45–54
Fengxi Song, Jingyu Yang, Shuhai Liu (2004) Large margin linear projection and face recognition. Pattern Recognit 37(9):1953–1955
Vapnik V (1995) The nature of statistical learning theory. Springer, Berlin Heidelberg New York
Jonsson K, Matas J et al (2000) Learning support vectors for face verification and recognition. In: Proceedings of 4th IEEE international conference automatic face and gesture recognition, pp 208–213
Guo G, Li SZ, Chan KL (2001) Support vector machines for face recognition. Image Vis Comput 19:631–638
Turk M, Pentland A (1991) Face recognition using eigenfaces. In: Procedings of IEEE conference on computer vision and pattern recognition, pp 586–591
Eschenauer H, Koski J, Osyczka A (1990) Multicriteria design optimization. Springer, Berlin Heidelberg New York
Cheng Y (1989) Matrix theory. Northwest Industrial University Press, Xian
Cao Z (1980) Eigenvalue problems. Shanghai Science And Technology Press, Shanghai
Murphy PM, Aha DW (1992) UCI repository of machine learning databases, http://www.ics.uci.edu/∼mlearn/MLRepository.html
Phillips PJ, Moon H, Rizvi SA, Rauss PJ (2000) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intell 20(10):1090–1104
Jian Yang, Jing-yu Yang, Frangi AF (2003) Combined Fisherfaces framework. Image Vis Comput 21:1037–1044
Martinez AM, Benavente R (1998) The AR Face Database. CVC Technical Report, no. 24, June 1998
Jian Yang, David Zhang, Frangi AF, Jing-yu Yang (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137
Hsu C, Lin C (2002) A comparison of methods for multi-class support vector machines. IEEE Trans Neural Netw 13(2):415–425
Acknowledgments
This work is partially supported by the National Science Foundation of China under grant no. 60620160097.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Song, F., Zhang, D., Chen, Q. et al. Face recognition based on a novel linear discriminant criterion. Pattern Anal Applic 10, 165–174 (2007). https://doi.org/10.1007/s10044-006-0057-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-006-0057-3