Abstract
In this paper, a new 1-parameter regularized discriminant analysis (1PRDA) algorithm is developed to deal with the small sample size (S3) problem. The main limitation in regularization is that the computational complexity of determining the optimal parameters is very high. In view of this limitation, we derive a single parameter (t) explicit expression formula for determining the 3 parameters. A simple and efficient method is proposed to determine the value of t. The proposed 1PRLDA method for face recognition has been evaluated with two public available databases, namely ORL and FERET databases. The average recognition accuracy of 50 runs for ORL and FERET database are 96.65% and 94.00% respectively. Comparing with existing LDA-based methods in solving the S3 problem, the proposed 1PRLDA method gives the best performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Swets, D., Weng, J.: Using discriminant eigenfeatures for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 831–836 (1996)
Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data — with application to face recognition. Pattern Recognition 34, 2067–2070 (2001)
Chen, L., Liao, H., Ko, M., Lin, J., Yu, G.: A new LDA-based face recognition system, which can solve the small sample size problem. Pattern Recognition 33(10), 1713–1726 (2000)
Liu, K., Cheng, Y., Yang, J.: Algebraic feature extraction for image recognition based on an optimal discriminant criterion. Pattern Recognition 26(6), 903–911 (1993)
Liu, K., Cheng, Y., Yang, J., Liu, J.: An efficient algorithm for Foley-Sammon optimal set of discriminant vectors by algebraic method. International Journal of Pattern Analysis and Artificial Intelligence 6(5), 817–829 (1992)
Jin, Z., Yang, J.Y., Hu, Z.S., Lou, Z.: Face recognition based on the uncorrelated discriminant transform. Pattern Recognition 34, 1405–1416 (2001)
Martinez, A.M., Kak, A.C.: PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 23, 228–233 (2001)
Martinez, A.M.: Recognizing imprecisely localized partially occluded and expression variant faces from a single sample per class. IEEE Trans. Pattern Anal. Mach. Intell. 24(6), 748–763 (2002)
Zhao, W., Chellappa, R., Phillips, P.J.: Subspace linear discriminant analysis for face recognition. Technical Report CAR-TR-914, CS-TR-4009, University of Maryland at College Park, USA (1999)
Huang, R., Liu, Q., Lu, H., Ma, S.: Solving small sample size problem in LDA. Proceeding of International Conference in Pattern Recognition (ICPR 2002) 3, 29–32 (2002)
Goudail, F., Lange, E., Iwamoto, T., Kyuma, K., Otsu, N.: Face recognition system using local autocorrelations and multiscale integration. IEEE Trans. Pattern Anal. Mach. Intell. 18(10), 1024–1028 (1996)
Tian, Q., Barbero, M., Gu, Z.H., Lee, S.H.: Image classification by the Foley-Sammon transform. Opt. Eng. 25(7), 834–840 (1986)
Krzanowski, W.J., Jonathan, P., McCarthy, W.V., Thomas, M.R.: Discriminant analysis with singular covariance matrices: methods and applications to spectroscopic data. Appl. Statist. 44, 101–115 (1995)
Dai, D.Q., Yuen, P.C.: Regularized discriminant analysis and its application on face recognition. Pattern Recognition 36, 845–847 (2003)
Dai, D.Q., Yuen, P.C.: A wavelet-based 2-parameter regularization discriminant analysis for face recognition. In: Proceeding of The 4th International Conference on Audio and Video Based Personal Authentication, Accepted for publication (2003)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face Recognition Using Kernel Direct Discriminant Analysis Algorithms. IEEE Transactions on Neural Networks 14(1), 117–126 (2003)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face Recognition Using LDA Based Algorithms. IEEE Transactions on Neural Networks 14(1), 195–200 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, W., Yuen, P.C., Huang, J., Dai, D. (2004). A Novel One-Parameter Regularized Linear Discriminant Analysis for Solving Small Sample Size Problem in Face Recognition. In: Li, S.Z., Lai, J., Tan, T., Feng, G., Wang, Y. (eds) Advances in Biometric Person Authentication. SINOBIOMETRICS 2004. Lecture Notes in Computer Science, vol 3338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30548-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-540-30548-4_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24029-7
Online ISBN: 978-3-540-30548-4
eBook Packages: Computer ScienceComputer Science (R0)