Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Multi-class Fukunaga Koontz discriminant analysis for enhanced face recognition

Published: 01 April 2016 Publication History

Abstract

Linear subspace learning methods such as Fisher's Linear Discriminant Analysis (LDA), Unsupervised Discriminant Projection (UDP), and Locality Preserving Projections (LPP) have been widely used in face recognition applications as a tool to capture low dimensional discriminant information. However, when these methods are applied in the context of face recognition, they often encounter the small-sample-size problem. In order to overcome this problem, a separate Principal Component Analysis (PCA) step is usually adopted to reduce the dimensionality of the data. However, such a step may discard dimensions that contain important discriminative information that can aid classification performance. In this work, we propose a new idea which we named Multi-class Fukunaga Koontz Discriminant Analysis (FKDA) by incorporating the Fukunaga Koontz Transform within the optimization for maximizing class separation criteria in LDA, UDP, and LPP. In contrast to traditional LDA, UDP, and LPP, our approach can work with very high dimensional data as input, without requiring a separate dimensionality reduction step to make the scatter matrices full rank. In addition, the FKDA formulation seeks optimal projection direction vectors that are orthogonal which the existing methods cannot guarantee, and it has the capability of finding the exact solutions to the "trace ratio" objective in discriminant analysis problems while traditional methods can only deal with a relaxed and inexact "ratio trace" objective. We have shown using six face database, in the context of large scale unconstrained face recognition, face recognition with occlusions, and illumination invariant face recognition, under "closed set", "semi-open set", and "open set" recognition scenarios, that our proposed FKDA significantly outperforms traditional linear discriminant subspace learning methods as well as five other competing algorithms. HighlightsSolve small-sample-size problem in LDA, UDP, LPP using FKT formulation.Can work with high dimensional data without inverting any scatter matrices.Finds optimal projection direction vectors that are orthogonal.Finds exact solutions to the objective in the form of trace ratio.Improvement in unconstrained face recognition scenarios.

References

[1]
M.A. Turk, A.P. Pentland, Face recognition using eigenfaces, in: IEEE Conference on Computer Vision and Pattern Recognition, 1991, pp. 586-591.
[2]
P.N. Belhumeur, J.P. Hespanha, D.J. Kriegman, Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Trans. Pattern Anal. Mach. Intell. 19 (7) (1997) 711-720.
[3]
J. Yang, D. Zhang, Z. Jin, J.-Y. Yang, Unsupervised discriminant projection analysis for feature extraction, in: International Conference on Pattern Recognition, vol. 1, 2006, pp. 904-907.
[4]
J.B. Tenenbaum, V. de Silva, J.C. Langford, A global geometric framework for nonlinear dimensionality reduction, Science, 22 (2000) 2319-2323.
[5]
S.T. Roweis, L.K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science, 22 (2000) 2323-2326.
[6]
M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral techniques for embedding and clustering, in: Proceedings of Neural Information Processing Systems, 2001.
[7]
X. He, P. Niyogi, Locality preserving projections, in: Proceedings of Neural Information Processing Systems, 2003.
[8]
A. Hadid, M. Pietikäinen, Demographic classification from face videos using manifold learning, Neurocomputing, 100 (2013) 197-205.
[9]
O. Arandjelović, R. Cipolla, Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant, Pattern Recognit., 46 (2013) 9-23.
[10]
H.T. Ho, R. Gopalan, Model-driven domain adaptation on product manifolds for unconstrained face recognition, Int. J. Comput. Vis., 109 (2014) 110-125.
[11]
O. Arandjelovic, Gradient edge map features for frontal face recognition under extreme illumination changes, in: BMVC 2012-Proceedings of the British Machine Vision Association Conference, BMVA Press, 2012, pp. 1-11.
[12]
K. Fukunaga, Introduction to Statistical Pattern Recognition, 1990.
[13]
Y. hui Li, M. Savvides, Kernel Fukunaga-Koontz transform subspaces for enhanced face recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
[14]
D.L. Swets, J. Weng, Using discriminant eigenfeatures for image retrieval, IEEE Trans. Pattern Anal. Mach. Intell., 18 (1996) 831-836.
[15]
L.F. Chen, H.Y.M. Liao, M.T. Ko, J.C. Lin, G.J. Yu, A new LDA-based face recognition system which can solve the small sample size problem, Pattern Recognit., 33 (2000) 1713-1726.
[16]
J.H. Friedman, Regularized discriminant analysis, J. Am. Stat. Assoc., 84 (1989) 165-175.
[17]
D.Q. Dai, P.C. Yuen, Regularized discriminant analysis and its application to face recognition, Pattern Recognit., 36 (2003) 845-847.
[18]
W.J. Krzanowski, P. Jonathan, W.V. McCarthy, M.R. Thomas, Discriminant analysis with singular covariance matrices: methods and applications to spectroscopic data, Appl. Stat., 44 (1995) 101-115.
[19]
T. Hastie, A. Buja, R. Tibshirani, Penalized discriminant analysis, Ann. Stat., 23 (1995) 73-102.
[20]
S. Raudys, R.P.W. Duin, On expected classification error of the fisher linear classifier with pseudo-inverse covariance matrix, Pattern Recognit. Lett., 19 (1998) 385-392.
[21]
M. Skurichina, R.P.W. Duin, Stabilizing classifiers for very small sample size, in: Proceedings of the International Conference on Pattern Recognition, 1996, pp. 891-896.
[22]
G.H. Golub, C.F. Van Loan, Matrix Computations, The Johns Hopkins University Press, Baltimore, Maryland, USA, 1996.
[23]
P. Howland, M. Jeon, H. Park, Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition, SIAM J. Matrix Anal. Appl., 25 (2003) 165-179.
[24]
J. Ye, R. Janardan, C.H. Park, H. Park, An optimization criterion for generalized discriminant analysis on undersampled problems, IEEE Trans. Pattern Anal. Mach. Intell., 26 (2004) 982-994.
[25]
R. Huang, Q. Liu, H. Lu, S. Ma, Solving the small sample size problem of LDA, in: 2002 Proceedings of the 16th International Conference on Pattern Recognition, vol. 3, IEEE, Quebec City, Canada, 2002, pp. 29-32.
[26]
M. Kyperountas, A. Tefas, I. Pitas, Weighted piecewise LDA for solving the small sample size problem in face verification, IEEE Trans. Neural Netw., 18 (2007) 506-519.
[27]
Y.-F. Guo, S.-J. Li, J.-Y. Yang, T.-T. Shu, L.-D. Wu, A generalized Foley-Sammon transform based on generalized fisher discriminant criterion and its application to face recognition, Pattern Recognit. Lett., 24 (2003) 147-158.
[28]
C. Shen, H. Li, M.J. Brooks, A convex programming approach to the trace quotient problem, in: Computer Vision-ACCV 2007, Springer, Tokyo, Japan, 2007, pp. 227-235.
[29]
Y. Jia, F. Nie, C. Zhang, Trace ratio problem revisited, IEEE Trans. Neural Netw., 20 (2009) 729-735.
[30]
J. Yang, D. Zhang, J.-Y. Yang, B. Niu, Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics, IEEE Trans. Pattern Anal. Mach. Intell. 29 (4) (2008) 650-664.
[31]
F. Chung, Spectral graph theory, in: Proceedings of the Regional Conference Series in Mathematics, No. 92, 1997.
[32]
X. He, S. Yan, Y. Hu, P. Niyogi, H.-J. Zhang, Face recognition using Laplacianfaces, IEEE Trans. Pattern Anal. Mach. Intell. 27 (March (3) (2005)) 328-340.
[33]
W. Deng, J. Hu, J. Guo, H. Zhang, C. Zhang, Comments on "globally maximizing, locally minimizing: unsupervised discriminant projection with application to face and palm biometrics", IEEE Trans. Pattern Anal. Mach. Intell. 30 (August (8) (2008)) 1503-1504.
[34]
H. Wang, S. Yan, D. Xu, X. Tang, T. Huang, Trace ratio vs. ratio trace for dimensionality reduction, in: 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-8.
[35]
P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, W. Worek, Overview of the face recognition grand challenge, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, 2005, pp. 947-954.
[36]
A.S. Georghiades, P.N. Belhumeur, D.J. Kriegman, From few to many, IEEE Trans. Pattern Anal. Mach. Intell., 23 (2001) 643-660.
[37]
K.-C. Lee, J. Ho, D.J. Kriegman, Acquiring linear subspaces for face recognition under variable lighting, IEEE Trans. Pattern Anal. Mach. Intell., 27 (2005) 684-698.
[38]
A.M. Martinez, R. Benavente, The AR face database, Technical Report 24, CVC Technical Report, June 1998.
[39]
R. Gross, I. Matthews, J.F. Cohn, T. Kanade, S. Baker, Multi-PIE, in: FG, 2008.
[40]
Pinellas County Sherrif's Office {http://www.pcsoweb.com/}.
[41]
G.B. Huang, M. Ramesh, T. Berg, E. Learned-Miller, Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, Technical Report 07-49, University of Massachusetts, Amherst, October 2007.
[42]
F. Juefei-Xu, M. Savvides, An augmented linear discriminant analysis approach for identifying identical twins with the aid of facial asymmetry features, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2013, pp. 56-63.
[43]
F. Juefei-Xu, K. Luu, M. Savvides, T. Bui, C. Suen, Investigating age invariant face recognition based on periocular biometrics, in: 2011 International Joint Conference on Biometrics (IJCB), 2011, pp. 1-7.
[44]
F. Juefei-Xu, M. Savvides, Unconstrained periocular biometric acquisition and recognition using COTS PTZ camera for uncooperative and non-cooperative subjects, in: 2012 IEEE Workshop on Applications of Computer Vision (WACV), 2012, pp. 201-208.
[45]
F. Juefei-Xu, M. Savvides, Can your eyebrows tell me who you are?, in: 2011 5th International Conference on Signal Processing and Communication Systems (ICSPCS), 2011, pp. 1-8.
[46]
F. Juefei-Xu, M. Cha, M. Savvides, S. Bedros, J. Trojanova, Robust periocular biometric recognition using multi-level fusion of various local feature extraction techniques, in: IEEE 17th International Conference on Digital Signal Processing (DSP), 2011.
[47]
F. Juefei-Xu, M. Cha, J.L. Heyman, S. Venugopalan, R. Abiantun, M. Savvides, Robust local binary pattern feature sets for periocular biometric identification, in: 4th IEEE International Conference on Biometrics: Theory Applications and Systems (BTAS), 2010, pp. 1-8.
[48]
F. Juefei-Xu, M. Savvides, Pokerface: partial order keeping and energy repressing method for extreme face illumination normalization, in: 2015 IEEE Seventh International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2015, pp. 1-8.
[49]
F. Juefei-Xu, M. Savvides, Single face image super-resolution via solo dictionary learning, in: IEEE International Conference on Image Processing (ICIP), 2015.
[50]
F. Juefei-Xu, M. Savvides, Pareto-optimal discriminant analysis, in: IEEE International Conference on Image Processing (ICIP), 2015.
[51]
F. Juefei-Xu, M. Savvides, Encoding and decoding local binary patterns for harsh face illumination normalization, in: IEEE International Conference on Image Processing (ICIP), 2015.
[52]
F. Juefei-Xu, D.K. Pal, M. Savvides, NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction, in: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015.
[53]
F. Juefei-Xu, D.K. Pal, K. Singh, M. Savvides, A preliminary investigation on the sensitivity of COTS face recognition systems to forensic analyst-style face processing for occlusions, in: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015.
[54]
K. Seshadri, F. Juefei-Xu, D.K. Pal, M. Savvides, Driver cell phone usage detection on strategic highway research program (SHRP2) face view videos, in: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015.
[55]
F. Juefei-Xu, D.K. Pal, M. Savvides, Hallucinating the full face from the periocular region via dimensionally weighted K-SVD, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2014.
[56]
G.B. Huang, E. Learned-Miller, Labeled faces in the wild: updates and new reporting procedures, in: UMass Amherst Technical Report UM-CS-2014-003, 2014.
[57]
W.J. Scheirer, A. Rocha, A. Sapkota, T.E. Boult, Towards open set recognition, IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36 (2013).
[58]
U. Prabhu, J. Heo, M. Savvides, Unconstrained pose-invariant face recognition using 3d generic elastic models, IEEE Trans. Pattern Anal. Mach. Intell., 33 (2011) 1952-1961.
[59]
D. Chen, X. Cao, F. Wen, J. Sun, Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Portland, Oregon, USA, 2013, pp. 3025-3032.
[60]
M. Savvides, F. Juefei-Xu, Image matching using subspace-based discrete transform encoded local binary patterns, US Patent US 2014/0212044 A1, September 2013.
[61]
F. Juefei-Xu, M. Savvides, Weight-optimal local binary patterns, in: Computer Vision-ECCV 2014 Workshops, Lecture Notes in Computer Science, vol. 8926, Springer International Publishing, Zurich, Switzerland, 2015, pp. 148-159.
[62]
F. Juefei-Xu, M. Savvides, Subspace based discrete transform encoded local binary patterns representations for robust periocular matching on NIST's face recognition grand challenge, IEEE Trans. Image Process., 23 (2014) 3490-3505.
[63]
Felix Juefei-Xu, Khoa Luu, Marios Savvides, Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios, IEEE Trans. Image Process. 24, 12 (2015) 4780-4795.
[64]
Felix Juefei-Xu, Dipan K. Pal, Marios Savvides, Methods and software for hallucinating facial features by prioritizing reconstruction errors, U.S. Provisional Patent Application Serial No. 61/998,043, June 17, 2014.
[65]
Niv Zehngut, Felix Juefei-Xu, Rishabh Bardia, Dipan K. Pal, Chandrasekhar Bhagavatula, and Marios Savvides, Investigating the feasibility of image-based nose biometrics, in: Proceedings of the IEEE International Conference on Image Processing (ICIP), 2015.
[66]
Felix Juefei-Xu, Marios Savvides, Facial ethnic appearance synthesis, in: Proceedings of Soft Biometrics Workshop, European Conference on Computer Vision (ECCV), 2014.
[67]
Felix Juefei-Xu, Marios Savvides, An image statistics approach towards efficient and robust refinement for landmarks on facial boundary, in: Proceedings of IEEE 6th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2013.
[68]
Shreyas Venugopalan, Felix Juefei-Xu, Benjamin Cowley, Marios Savvides, Electromyograph and keystroke dynamics for spoof-resistant biometric authentication, in: Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
[69]
Felix Juefei-Xu, Chandrasekhar Bhagavatula, Aaron Jaech, Unni Prasad, Marios Savvides, Gait-ID on the move: pace independent human identification using cell phone accelerometer dynamics, in: Proceedings of IEEE 5th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2012.

Cited By

View all
  • (2020)Amora: Black-box Adversarial Morphing AttackProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413544(1376-1385)Online publication date: 12-Oct-2020
  • (2019)Learning and the unknownProceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v33i01.33019801(9801-9807)Online publication date: 27-Jan-2019
  • (2018)Cognitive Gravity Model Based Semi-Supervised Dimension ReductionNeural Processing Letters10.1007/s11063-017-9648-947:1(253-276)Online publication date: 1-Feb-2018
  1. Multi-class Fukunaga Koontz discriminant analysis for enhanced face recognition

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Pattern Recognition
    Pattern Recognition  Volume 52, Issue C
    April 2016
    477 pages

    Publisher

    Elsevier Science Inc.

    United States

    Publication History

    Published: 01 April 2016

    Author Tags

    1. Face recognition
    2. Fukunaga Koontz transform
    3. Linear discriminant analysis
    4. Locality preserving projections
    5. Unsupervised discriminant projection

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)Amora: Black-box Adversarial Morphing AttackProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413544(1376-1385)Online publication date: 12-Oct-2020
    • (2019)Learning and the unknownProceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v33i01.33019801(9801-9807)Online publication date: 27-Jan-2019
    • (2018)Cognitive Gravity Model Based Semi-Supervised Dimension ReductionNeural Processing Letters10.1007/s11063-017-9648-947:1(253-276)Online publication date: 1-Feb-2018

    View Options

    View options

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media