research-article

Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction

Authors:

Shuicheng YanAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 26, Issue 4

Pages 1607 - 1622

https://doi.org/10.1109/TIP.2017.2654163

Published: 01 April 2017 Publication History

Abstract

We propose two nuclear- and L2,1-norm regularized 2D neighborhood preserving projection (2DNPP) methods for extracting representative 2D image features. 2DNPP extracts neighborhood preserving features by minimizing a Frobenius norm-based reconstruction error that is very sensitive noise and outliers in given data. To make the distance metric more reliable and robust, and encode the neighborhood reconstruction error more accurately, we minimize the nuclear- and L2,1-norm-based reconstruction error, respectively and measure it over each image. Technically, we propose two enhanced variants of 2DNPP, nuclear-norm-based 2DNPP and sparse reconstruction-based 2DNPP. Besides, to optimize the projection for more promising feature extraction, we also add the nuclear- and sparse L2,1-norm constraints on it accordingly, where L2,1-norm ensures the projection to be sparse in rows so that discriminative features are learnt in the latent subspace and the nuclear-norm ensures the low-rank property of features by projecting data into their respective subspaces. By fully considering the neighborhood preserving power, using more reliable and robust distance metric, and imposing the low-rank or sparse constraints on projections at the same time, our methods can outperform related state-of-the-arts in a variety of simulation settings.

References

[1]

S. T. Roweis and L. K. Saul, “Nonlinear dimensionality reduction by locally linear embedding,” Science, vol. Volume 290, no. Issue 5500, pp. 2323–2326, 2000.

[2]

M. Belkin and P. Niyogi, “Laplacian eigenmaps for dimensionality reduction and data representation,” Neural Comput., vol. Volume 15, no. Issue 6, pp. 1373–1396, 2003.

Digital Library

[3]

M. A. Turk and A. P. Pentland, “Face recognition using eigenfaces,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 1991, pp. 586–591.

[4]

X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, “Face recognition using Laplacianfaces,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 27, no. Issue 3, pp. 328–340, 2005.

Digital Library

[5]

X. He, D. Cai, S. Yan, and H.-J. Zhang, “Neighborhood preserving embedding,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Beijing, China, Oct. 2005, pp. 1208–1213.

Digital Library

[6]

E. Kokiopoulou and Y. Saad, “Orthogonal neighborhood preserving projections: A projection-based dimensionality reduction technique,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 29, no. Issue 12, pp. 2143–2156, 2007.

Digital Library

[7]

J. Yang, D. Zhang, A. F. Frangi, and J.-Y. Yang, “Two-dimensional PCA: A new approach to appearance-based face representation and recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 26, no. Issue 1, pp. 131–137, 2004.

Digital Library

[8]

S. Chen, H. Zhao, M. Kong, and B. Luo, “2D-LPP: A two-dimensional extension of locality preserving projections,” Neurocomputing, vol. Volume 70, nos. Issue 4</issue>–<issue>6, pp. 912–921, 2007.

Digital Library

[9]

H. Zhang, Q. M. J. Wu, T. W. S. Chow, and M. Zhao, “A two-dimensional neighborhood preserving projection for appearance-based face recognition,” Pattern Recognit., vol. Volume 45, no. Issue 5, pp. 1866–1876, 2012.

Digital Library

[10]

F. Zhang, J. Yang, J. Qian, and Y. Xu, “Nuclear norm-based 2-DPCA for extracting features from images,” IEEE Trans. Neural Netw. Learn. Syst., vol. Volume 26, no. Issue 10, pp. 2247–2260, 2015.

[11]

M. Fornasier, H. Rauhut, and R. Ward, “Low-rank matrix recovery via iteratively reweighted least squares minimization,” SIAM J. Optim., vol. Volume 21, no. Issue 4, pp. 1614–1640, 2011.

Digital Library

[12]

Y. Yang, H. T. Shen, Z. G. Ma, Z. Huang, and X. F. Zhou, “<inline-formula><tex-math notation=LaTeX>$L_{2, 1}$</tex-math></inline-formula>-norm regularized discriminative feature selection for unsupervised learning,” in Proc. Int. Joint Conf. Artif. Intell., 2011, pp. 1589–1594.

Digital Library

[13]

C. Hou, F. Nie, X. Li, D. Yi, and Y. Wu, “Joint embedding learning and sparse regression: A framework for unsupervised feature selection,” IEEE Trans. Cybern., vol. Volume 44, no. Issue 6, pp. 793–804, 2014.

[14]

Z. Zhang, L. Zhang, M. B. Zhao, W. Jiang, Y. Liang, and F. Li, “Semi-supervised image classification by nonnegative sparse neighborhood propagation,” in Proc. ACM Int. Conf. Multimedia Retr., Shanghai, China, Jun. 2015, pp. 139–146.

Digital Library

[15]

Z. Gu, M. Shao, L. Li, and Y. Fu, “Discriminative metric: Schatten norm vs. vector norm,” in Proc. 21st IEEE Conf. Pattern Recognit., Nov. 2012, pp. 1213–1216.

[16]

F. Nie, H. Huang, C. Ding, D. Luo, and H. Wang, “Robust principal component analysis with non-greedy l1-norm maximization,” in Proc. Int. Joint Conf. Artif. Intell., Barcelona, Spain, 2011, pp. 1433–1438.

Digital Library

[17]

J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, “Robust face recognition via sparse representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 31, no. Issue 2, pp. 210–227, 2009.

Digital Library

[18]

Z. Wang, S. Chen, J. Liu, and D. Zhang, “Pattern representation in feature extraction and classifier design: Matrix versus vector,” IEEE Trans. Neural Netw., vol. Volume 19, no. Issue 5, pp. 758–769, 2008.

Digital Library

[19]

Z. Zhang and W. S. Chow, “Tensor locally linear discriminative analysis,” IEEE Signal Process. Lett., vol. Volume 18, no. Issue 11, pp. 843–846, 2011.

[20]

E. J. Candès, X. Li, Y. Ma, and J. Wright, “Robust principal component analysis?” J. ACM, vol. Volume 58, no. Issue 1, pp. 1–37, 2009.

Digital Library

[21]

G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, “Robust recovery of subspace structures by low-rank representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 35, no. Issue 1, pp. 171–184, 2013.

Digital Library

[22]

Z. Zhang, F. Li, M. Zhao, L. Zhang, and S. Yan, “Joint low-rank and sparse principal feature coding for enhanced robust representation and visual classification,” IEEE Trans. Image Process., vol. Volume 25, no. Issue 6, pp. 2429–2443, 2016.

Digital Library

[23]

B.-K. Bao, G. Liu, C. Xu, and S. Yan, “Inductive robust principal component analysis,” IEEE Trans. Image Process., vol. Volume 21, no. Issue 8, pp. 3794–3800, 2012.

Digital Library

[24]

G. Liu and S. Yan, “Latent low-rank representation for subspace segmentation and feature extraction,” in Proc. Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 1615–1622.

Digital Library

[25]

Z. Zhang, S. Yan, and M. Zhao, “Similarity preserving low-rank representation for enhanced data representation and effective subspace learning,” Neural Netw., vol. Volume 53, pp. 81–94, 2014.

[26]

X. Li, Y. Pang, and Y. Yuan, “L1-norm-based 2DPCA,” IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. Volume 40, no. Issue 4, pp. 1170–1175, 2009.

Digital Library

[27]

M. Sugiyama, “Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis,” J. Mach. Learn. Res., vol. Volume 8, pp. 1027–1061, 2007.

Digital Library

[28]

L. Zelnik-Manor and P. Perona, “Self-tuning spectral clustering,” in Proc. Adv. Neural Inf. Process. Syst., Cambridge, MA, USA, vol. Volume 17 . 2005, pp. 1601–1608.

Digital Library

[29]

F. Rothganger, S. Lazebnik, C. Schmid, and J. Ponce, “3D object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints,” Int. J. Comput. Vis., vol. Volume 66, no. Issue 3, pp. 231–259, 2006.

Digital Library

[30]

Z. Zhang, F. Li, M. B. Zhao, L. Zhang, and S. C. Yan, “Nuclear-norm regularized neighborhood preserving projection,” in Proc. 23rd Int. Conf. Image Process., Phoenix, AZ, USA, Sep. 2016, pp. 56–60.

[31]

B. Weyrauch, J. Huang, B. Heisele, and V. Blanz, “Component-based face recognition with 3D morphable models,” in Proc. 1st IEEE Workshop Face Process. Video, Washington, DC, USA, Jun. 2004, p. pp.85.

Digital Library

[32]

D. B. Graham and N. Allinson, “<chapter-title>Characterizing virtual eigensignatures for general purpose face recognition</chapter-title>,” Face Recognition: From Theory to Applications (NATO ASI Series F, Computer and Systems Sciences), vol. Volume 163 . Berlin, Geermany: Springer, 1998, pp. 446–456.

[33]

M. J. Lyons, J. Budynek, and S. Akamatsu, “Automatic classification of single facial images,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 21, no. Issue 12, pp. 1357–1362, 1999.

Digital Library

[34]

V. Vonikakis, D. Chrysostomou, R. Kouskouridas, and A. Gasteratos, “Improving the robustness in feature detection by local contrast enhancement,” in Proc. IEEE Int. Conf. Imaging Syst. Techn., Manchester, U.K., Jul. 2012, pp. 158–163.

[35]

Z. Zhang, T. W. S. Chow, and M. B. Zhao, “Trace ratio optimization-based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization,” IEEE Trans. Knowl. Data Eng., vol. Volume 25, no. Issue 5, pp. 1148–1161, 2013.

Digital Library

[36]

S.-Q. Zhang, “Enhanced supervised locally linear embedding,” Pattern Recognit. Lett., vol. Volume 30, no. Issue 13, pp. 1208–1218, 2009.

Digital Library

[37]

X. Geng, D.-C. Zhan, and Z.-H. Zhou, “Supervised nonlinear dimensionality reduction for visualization and classification,” IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. Volume 35, no. Issue 6, pp. 1098–1107, 2005.

Digital Library

[38]

F. Nie, H. Huang, X. Cai, and C. Ding, “Efficient and robust feature selection via joint <inline-formula><tex-math notation=LaTeX>$L_{2, 1}$</tex-math></inline-formula>-norms minimization,” in Proc. Neural Inf. Process. Syst. (NIPS), 2010, pp. 1813–1821.

Digital Library

[39]

O. L. Mangasarian and E. W. Wild, “Multisurface proximal support vector machine classification via generalized eigenvalues,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 28, no. Issue 1, pp. 69–74, 2006.

Digital Library

[40]

D. Tao, X. Li, X. Wu, and S. J. Maybank, “Geometric mean for subspace selection,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 31, no. Issue 2, pp. 260–274, 2009.

Digital Library

[41]

J. Li and D. Tao, “On preserving original variables in Bayesian PCA with application to image analysis,” IEEE Trans. Image Process., vol. Volume 21, no. Issue 12, pp. 4830–4843, 2012.

Digital Library

[42]

T. Sim, S. Baker, and M. Bsat, “The CMU pose, illumination, and expression database,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 25, no. Issue 12, pp. 1615–1618, 2003.

Digital Library

Cited By

Crook OCucuringu MHurst TSchönlieb CThorpe MZygalakis K(2024)A linear transportation L p distance for pattern recognitionPattern Recognition10.1016/j.patcog.2023.110080147:COnline publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1016/j.patcog.2023.110080
Zhou JPedrycz WWan JGao CLai ZYue X(2023)Low-Rank Linear Embedding for Robust ClusteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.314429435:5(5060-5075)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TKDE.2022.3144294
Gou JYuan XXue YDu LYu JXia SZhang Y(2023)Discriminative and Geometry-Preserving Adaptive Graph Embedding for dimensionality reductionNeural Networks10.1016/j.neunet.2022.10.024157:C(364-376)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.neunet.2022.10.024
Show More Cited By

Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
  2. Computer graphics

Recommendations

Tensor Locality Preserving Sparse Projection for Image Feature Extraction

Manifold learning is a hot topic in feature extraction, wherein high-dimensional data is represented in a potential low-dimensional manifold. In this paper, a novel manifold-learning method called tensor locality preserving sparse projection (TLPSP) is ...
Recursive locality preserving projection for feature extraction

In this paper, we develop a novel feature extractor called recursive locality preserving projection (RLPP). RLPP inherits the advantages of LPP and at the same time makes some improvements. In RLPP, two local weight graphs are constructed. By combining ...
Image compressive sensing via Truncated Schatten-p Norm regularization

Low-rank property as a useful image prior has attracted much attention in image processing communities. Recently, a nonlocal low-rank regularization (NLR) approach toward exploiting low-rank property has shown the state-of-the-art performance in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 26, Issue 4

April 2017

526 pages

ISSN:1057-7149

Issue’s Table of Contents

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 01 April 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Crook OCucuringu MHurst TSchönlieb CThorpe MZygalakis K(2024)A linear transportation L p distance for pattern recognitionPattern Recognition10.1016/j.patcog.2023.110080147:COnline publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1016/j.patcog.2023.110080
Zhou JPedrycz WWan JGao CLai ZYue X(2023)Low-Rank Linear Embedding for Robust ClusteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.314429435:5(5060-5075)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TKDE.2022.3144294
Gou JYuan XXue YDu LYu JXia SZhang Y(2023)Discriminative and Geometry-Preserving Adaptive Graph Embedding for dimensionality reductionNeural Networks10.1016/j.neunet.2022.10.024157:C(364-376)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.neunet.2022.10.024
Zhang HBi HWang XZhang P(2023)A joint-norm distance metric 2DPCA for robust dimensionality reductionInformation Sciences: an International Journal10.1016/j.ins.2023.119036640:COnline publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1016/j.ins.2023.119036
Gao RCheng DChen LKou Q(2022)Locally Regularized Collaborative Representation and an Adaptive Low-Rank Constraint for Single Image SuperresolutionMobile Information Systems10.1155/2022/85659102022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/8565910
Wang SLiu XZhu XZhang PZhang YGao FZhu E(2022)Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor GuidanceIEEE Transactions on Image Processing10.1109/TIP.2021.313194131(556-568)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1109/TIP.2021.3131941
Li J(2022)Unsupervised robust discriminative subspace representation based on discriminative approximate isometric embeddingNeural Networks10.1016/j.neunet.2022.06.003155:C(287-307)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.neunet.2022.06.003
Chen XLai Z(2022)Jointly sparse least square support vector machineComputers and Electrical Engineering10.1016/j.compeleceng.2022.108078101:COnline publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1016/j.compeleceng.2022.108078
He KPeng YLiu SLi J(2022)Regularized label relaxation with negative technique for image classificationMultimedia Tools and Applications10.1007/s11042-022-12417-x81:28(41131-41149)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1007/s11042-022-12417-x
Liu JLin MZhao MZhan CLi BChui J(2022)Person re-identification via semi-supervised adaptive graph embeddingApplied Intelligence10.1007/s10489-022-03570-953:3(2656-2672)Online publication date: 11-May-2022
https://dl.acm.org/doi/10.1007/s10489-022-03570-9
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents