Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Locality preserving embedding for face and handwriting digital recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Most supervised manifold learning-based methods preserve the original neighbor relationships to pursue the discriminating power. Thus, structure information of the data distributions might be neglected and destroyed in low-dimensional space in a certain sense. In this paper, a novel supervised method, called locality preserving embedding (LPE), is proposed to feature extraction and dimensionality reduction. LPE can give a low-dimensional embedding for discriminative multi-class sub-manifolds and preserves principal structure information of the local sub-manifolds. In LPE framework, supervised and unsupervised ideas are combined together to learn the optimal discriminant projections. On the one hand, the class information is taken into account to characterize the compactness of local sub-manifolds and the separability of different sub-manifolds. On the other hand, at the same time, all the samples in the local neighborhood are used to characterize the original data distributions and preserve the structure in low-dimensional subspace. The most significant difference from existing methods is that LPE takes the distribution directions of local neighbor data into account and preserves them in low-dimensional subspace instead of only preserving the each local sub-manifold’s original neighbor relationships. Therefore, LPE optimally preserves both the local sub-manifold’s original neighborhood relationships and the distribution direction of local neighbor data to separate different sub-manifolds as far as possible. The criterion, similar to the classical Fisher criterion, is a Rayleigh quotient in form, and the optimal linear projections are obtained by solving a generalized Eigen equation. Furthermore, the framework can be directly used in semi-supervised learning, and the semi-supervised LPE and semi-supervised kernel LPE are given. The proposed LPE is applied to face recognition (on the ORL and Yale face databases) and handwriting digital recognition (on the USPS database). The experimental results show that LPE consistently outperforms classical linear methods, e.g., principal component analysis and linear discriminant analysis, and the recent manifold learning-based methods, e.g., marginal Fisher analysis and constrained maximum variance mapping.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37

    Article  Google Scholar 

  2. Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceeding of the fourth international conference of face and gesture recognition, Grenoble, France, pp 46–53

  3. Dubuisson S, Davoine F, Masson M (2002) A solution for facial expression representation and recognition. Signal Process Image Commun 17(9):657–673

    Article  Google Scholar 

  4. Joliffe I (1986) Principal component analysis. Springer, New York

    Google Scholar 

  5. Fukunnaga K (1991) Introduction to statistical pattern recognition, 2nd edn. Academic Press, London

    Google Scholar 

  6. Martinez AM, Kak AC (2001) PCA versus LDA. IEEE Trans Pattern Anal Mach Intell 23(2):228–233

    Article  Google Scholar 

  7. He X, Niyogi P (2003) Locality preserving projections. In: Proceedings of 16th conference neural information processing systems

  8. Goh A, Vidal R (2008) Clustering and dimensionality on Riemannian manifolds. IEEE Int Conf Comput Vis Pattern Recogn 1:1–7

    Google Scholar 

  9. Chung F (1997) Spectral graph theory. Regional conference series in mathematics, no. 92

  10. Jin Z, Yang J, Hu Z, Lou Z (2001) Face recognition based on the uncorrelated discrimination transformation. Pattern Recogn 34(7):1405–1416

    Article  MATH  Google Scholar 

  11. Belhumeour PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  12. Li H, Jiang T, Zhang K (2004) Efficient and robust feature extraction by maximum margin criterion. In: Proceedings of the advances in neural information processing systems, vol 16. MIT Press, Vancouver, Canada

  13. Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell (T-PAMI) 29(1):40–51

    Google Scholar 

  14. Tenenbaum JB, deSilva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323

    Article  Google Scholar 

  15. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326

    Article  Google Scholar 

  16. Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396

    Article  MATH  Google Scholar 

  17. Kouropteva O, Okun O, Pietikainen M (2003) Supervised locally linear embedding algorithm for pattern recognition. Lect Notes Comput Sci 2652:386–394

    Article  Google Scholar 

  18. Ridder D, Loog M, Reinders M (2004) Local fisher embedding. In: Proceedings of the 17th international conference on pattern recognition

  19. Vlassis N, Motomura Y, Krose B (2002) Supervised dimension reduction of intrinsically low dimensional data. Neural Comput 14(1):191–215

    Article  MATH  Google Scholar 

  20. Geng X, Zhang DC, Zhou ZH (2005) Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Trans Syst Man Cybern B 35(6):1098–1107

    Article  Google Scholar 

  21. Zhao HT, Sun SY, Jing ZL, Yang JY (2006) Local structure based supervised feature extraction. Pattern Recogn 39:1546–1550

    Article  MATH  Google Scholar 

  22. Yang J, Zhang D, Yang J-y, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE TPAMI 29(4):650–664

    Google Scholar 

  23. Deng W, Hu J, Guo J, Zhang H, Zhang C (2008) Comments on ‘globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics’. IEEE PAMI 30(8):1503–1504

    Google Scholar 

  24. Chen H-T, Chang H-W, Liu T-L (2005) Local discriminant embedding and its variants. IEEE Conf Comput Vis Pattern Recogn 2:846–853

    Google Scholar 

  25. Zhang T, Yang J, Wang H, Du C (2007) Maximum variance projection for face recognition. Opt Eng 46(6):1–8

    Google Scholar 

  26. Bo L, Huang D-S, Wang C, Liu K-H (2008) Feature extraction using constrained maximum variance mapping. Pattern Recogn 41:3287–3294

    Article  MATH  Google Scholar 

  27. Lai Z, Wan M, Jin Z (2009) Locality preserving embedding. In: Proceedings of the first international conference on information science and engineering, Nanjing, China, pp 895–899

  28. http://www.cs.nyu.edu/~roweis/data.html

Download references

Acknowledgments

This work is partially supported by the National Science Foundation of China under grant No. 60503026, 60632050, 60473039, 60873151, 61005005 and Hi-Tech Research and Development Program of China under grant No. 2006AA01Z119.

Author information

Authors and Affiliations

  1. School of Computer Science, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, People’s Republic of China

    Zhihui Lai, MingHua Wan & Zhong Jin

Authors
  1. Zhihui Lai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. MingHua Wan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhong Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhihui Lai.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lai, Z., Wan, M. & Jin, Z. Locality preserving embedding for face and handwriting digital recognition. Neural Comput & Applic 20, 565–573 (2011). https://doi.org/10.1007/s00521-011-0577-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0577-7

Keywords

Search

Navigation