Abstract
This work deals with the problem of multilinear principal component analysis (MPCA) and multilinear discriminant analysis (MDA), that solve for a tensor to tensor projection (TTP) using Einstein product. MPCA and MDA are considered as a higher-order extension of principal component analysis (PCA ) and linear discriminant analysis (LDA), respectively. MPCA seeks to find a low-dimensional representation that captures most of the variation present in the original data tensor. Whereas MDA seeks to find discriminative features that maximize the separation between classes, while preserving the multilinear structure. Specifically, we are interested in finding a projective tensor that maps the original data tensor onto a new lower-dimensional subspace. In this paper, we propose to solve the MPCA problem by employing the global Lanczos procedure via Einstein product for a fourth-order tensor, while solving the MDA problem by combining Newton method and global tensorial Lanczos method. The numerical experiments illustrate the use of these algorithms for face recognition problems, compression and classification.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Data will be made available on request.
References
Beik FPA, Movahed FS, Saberi F, Ahmadi-Asl S (2016) On the Krylov subspace methods based on tensor format for positive definite Sylvester tensor equations. Numer Linear Algebra Appl 23(3):444–466
Brazell M, Li N, Navasca C, Tamon C (2013) Solving multilinear systems via tensor inversion. SIAM J Matrix Anal Appl 34(2):542–570
Cao Z, Chen H, Wang X (2022) Spectral clustering on the local similarity measure of shared neighbors. ETRI J 44:769–779
Cui LB, Chen C, Li W, Ng MK (2016) An eigenvalue problem for even order tensors with its applications. Linear Multilinear Algebra 64(4):602–621
Einstein A (2007) The foundation of the general theory of relativity. In: Kox AJ, Klein MJ, Schulmann R (eds) The Collected Papers of Albert Einstein, vol 6, pp. 146–200
El Guide M, El Ichi A, Jbilou K, Beik FPA (2022) Tensor Krylov subspace methods via the Einstein product with applications to image and video processing. Appl Numer Math 181:347–363
El Hachimi A, Jbilou K, Hached M, Ratnani A (2023) Tensor Golub Kahan based on Einstein Product. https://doi.org/10.48550/arXiv.2311.03109
Han XH, Chen YW, Ruan X (2012) Multilinear supervised neighborhood embedding of a local descriptor tensor for scene/object recognition. IEEE Trans Image Process 21(3):1314–1326
Huang B, Li W (2021) Numerical subspace algorithms for solving the tensor equations involving Einstein product. Numer Linear Algebra Appl 28(2):2351
Huang B, Xie Y, Ma C (2019) Krylov subspace methods to solve a class of tensor equations via the Einstein product. Numer Linear Algebra Appl 26(4):2254
Inoue K, Hara K, Urahama K (2009) Robust multilinear principal component analysis. In: IEEE 12th international conference on computer vision, pp. 591–597
Kolda TG (2006) Multilinear operators for higher-order decompositions
Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51(3):455–500
Li Q, Schonfeld D (2014) Multilinear discriminant analysis for higher-order tensor data classification. IEEE Trans Pattern Anal Mach Intell 36(12):2524–2537
Liu Y-J, Wan Y, Lin L (2024) An efficient algorithm for Fantope-constrained sparse principal subspace estimation problem. Appl Math Comput 475:128708
Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: Multilinear principal component analysis of tensor objects. IEEE Trans Neural Netw 19(1):18–39
Lu H, Plataniotis KN, Venetsanopoulos AN (eds) (2014) Multilinear subspace learning: dimensionality reduction of multidimensional data. Chapman and Hall/CRC Press
Martinez AM, Benavente R (1998) The AR face database. CVC Technical Report No. 24
Nefian AV (2021) Georgia Tech face database. http://www.anefian.com/research/face_reco.htm
Ngo TT, Bellalij M, Saad Y (2012) The trace ratio optimization problem. SIAM Rev 54(3):545–569
Panagakis Y, Kotropoulos C, Arce GR (2010) Non-negative multilinear principal component analysis of auditory temporal modulations for music genre classification. IEEE Trans Audio Speech Lang Process 18(3):576–588
Sun L, Zheng B, Bu C, Wei Y (2016) Moore–Penrose inverse of tensors via Einstein product. Linear Multilinear Algebra 64(4):686–698
Sun J, Tao D, Faloutsos C (2006) Beyond streams and graphs: dynamic tensor analysis. In: Knowledge discovery and data mining
Sun J, Tao D, Papadimitriou S, Yu PS, Faloutsos C (2008) Incremental tensor analysis: theory and applications. ACM Trans Knowl Discov Data 2(3)
Tao D, Li X, Wu X, Maybank SJ (2007) General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans Pattern Anal Mach Intell 29(10):1700–1715
Tao D, Song M, Li X, Shen J, Sun J, Wu X, Faloutsos C, Maybank SJ (2008) Bayesian tensor approach for 3-d face modeling. IEEE Trans Circuits Syst Video Technol 18(10):1397–1410
Wang QW, Xu X (2019) Iterative algorithms for solving some tensor equations. Linear Multilinear Algebra 67(7):1325–1349
Wang SJ, Yang J, Sun MF, Peng XJ, Sun MM, Zhou CG (2012) Sparse tensor discriminant color space for face verification. IEEE Trans Neural Netw Learn Syst 23(6):876–888
Xu D, Yan S, Zhang L, Lin S, Zhang HJ, Huang TS (2008) Reconstruction and recognition of tensor-based objects with concurrent subspaces analysis. IEEE Trans Circuits Syst Video Technol 18(1):36–47
Yan S, Xu D, Yang Q, Zhang L, Tang X, Zhang HJ (2007) Multilinear discriminant analysis for face recognition. IEEE Trans Image Process 16(1):212–220
Yan S, Xu D, Yang Q, Zhang L, Tang X, Zhang HJ (2005) Discriminant analysis with tensor representation. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol 1, pp 526–532
Zhou H, Wang Z, Chen H, Wang X (2024) A novel spectral clustering algorithm based on neighbor relation and Gaussian kernel function with only one parameter. Soft Comput 28:981–989
Acknowledgements
The author would like to acknowledge the support of the OCP Foundation through the APRD research program for their generous funding that made this research possible.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author declares no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Andahmou, A. MPCA and MDA via Einstein product. Comp. Appl. Math. 43, 354 (2024). https://doi.org/10.1007/s40314-024-02866-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40314-024-02866-5