Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Tensor low-rank representation combined with consistency and diversity exploration

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In recent years, many tensor data processing methods have been proposed. Tensor low-rank representation (TLRR) is a recently proposed tensor-based clustering method that has shown good clustering performance in some applications. However, TLRR does not make full use of the consistency and diversity information hidden in different similarity matrices. Therefore, we propose the TLRR combined with consistency and diversity exploration (TLRR-CD) method. First, the tensor Frobenius norm and tensor product (t-product), which is defined as the multiplication of two tensors, are used to obtain the low-rank representation tensor, which can be seen as being composed of many similarity matrices. Second, the low-rank representation tensor is further decomposed into a consistent tensor, which contains the common structural information contained in the different similarity matrices, and a diversity tensor, which contains the locally specific structural information of different similarity matrices. Finally, the Hilbert–Schmidt Independence Criterion (HSIC), which is used to measure the relevance of local specific structural information, and spectral clustering are unified into the final objective function to improve clustering performance. In addition, the optimization process of TLRR-CD is also given. The experimental results show the good performance of TLRR-CD.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Fan K (1949) On a theorem of Weyl concerning eigenvalues of linear transformations. Proc Natl Acad Sci USA 35:652–655

    Article  MathSciNet  Google Scholar 

  2. Favaro P, Vidal R, Ravichandran A (2011) A closed form solution to robust subspace estimation and clustering. In: CVPR 2011, IEEE, pp. 1801–1807

  3. Lin Z, Liu R, Su Z (2011) Linearized alternating direction method with adaptive penalty for low-rank representation. In: Advances in Neural Information Processing Systems 24 (NIPS 2011)

  4. Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35:2765–2781

    Article  Google Scholar 

  5. Zhou P, Lu C, Feng J, Lin Z, Yan SJ (2019) Tensor low-rank representation for data recovery and clustering. IEEE Trans Pattern Anal Mach Intell 43:1718–1732

    Article  Google Scholar 

  6. Chen J, Mao H, Wang Z, Zhang X (2021) Low-rank representation with adaptive dictionary learning for subspace clustering. Knowl-Based Syst 223:107053

    Article  Google Scholar 

  7. Cai B, Lu G-F (2022) Tensor subspace clustering using consensus tensor low-rank representation. Inf Sci 609:46–59

    Article  Google Scholar 

  8. Du S, Liu B, Shan G, Shi Y, Wang W (2022) Enhanced tensor low-rank representation for clustering and denoising. Knowl-Based Syst 243:108468

    Article  Google Scholar 

  9. Yin J, Wu H, Sun S (2023) Effective sample pairs based contrastive learning for clustering. Inf Fusion 99:101899

    Article  Google Scholar 

  10. Candès EJ, Li X, Ma Y, Wright J (2011) Robust principal component analysis? J ACM 58:1–37

    Article  MathSciNet  Google Scholar 

  11. Du S, Ma Y, Ma Y (2017) Graph regularized compact low rank representation for subspace clustering. Knowl-Based Syst 118:56–69

    Article  Google Scholar 

  12. He W, Chen JX, Zhang W (2017) Low-rank representation with graph regularization for subspace clustering. Soft Comput 21:1569–1581

    Article  Google Scholar 

  13. Wang Q, He X, Li X (2018) Locality and structure regularized low rank representation for hyperspectral image classification. IEEE Trans Geosci Remote Sens 57:911–923

    Article  Google Scholar 

  14. Wen J, Fang X, Xu Y, Tian C, Fei L (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96

    Article  Google Scholar 

  15. Ding Y, Chong Y, Pan S (2020) Sparse and low-rank representation with key connectivity for hyperspectral image classification. IEEE J Sel Top Appl Earth Observ Remote Sens 13:5609–5622

    Article  Google Scholar 

  16. Zhou P, Du L, Li X (2023) Adaptive consensus clustering for multiple k-means via base results refining. IEEE Trans Knowl Data Eng 35:10251–10264

    Article  Google Scholar 

  17. Lai Z, Xu Y, Chen Q, Yang J, Zhang D (2014) Multilinear sparse principal component analysis. IEEE Trans Neural Netw Learn Syst 25:1942–1950

    Article  Google Scholar 

  18. Lai Z, Xu Y, Yang J, Tang J, Zhang D (2013) Sparse tensor discriminant analysis. IEEE Trans Image Process 22:3904–3915

    Article  MathSciNet  Google Scholar 

  19. Kilmer ME, Martin C (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435:641–658

    Article  MathSciNet  Google Scholar 

  20. Kilmer ME, Braman K, Hao N, Hoover R (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34:148–172

    Article  MathSciNet  Google Scholar 

  21. Kernfeld E, Kilmer M, Aeron S (2015) Tensor–tensor products with invertible linear transforms. Linear Algebra Appl 485:545–570

    Article  MathSciNet  Google Scholar 

  22. Lu C, Feng J, Chen Y, Liu W, Lin Z, Yan S (2020) Tensor robust principal component analysis with a new tensor nuclear norm. IEEE Trans Pattern Anal Mach Intell 42:925–938

    Article  Google Scholar 

  23. Du S, Shi Y, Shan G, Wang W, Ma Y (2021) Tensor low-rank sparse representation for tensor subspace learning. Knowl-Based Syst 440:351–364

    Google Scholar 

  24. Wang A, Zhao Q, Jin Z, Li C, Zhou G (2022) Robust tensor decomposition via orientation invariant tubal nuclear norms. Sci China Technol Sci 65:1300–1317

    Article  Google Scholar 

  25. Wang A, Zhou G, Jin Z, Zhao Q (2021) Tensor recovery via *_L-spectral k-support norm. IEEE J Sel Top Signal Process 15:522–534

    Article  Google Scholar 

  26. Cao X, Zhang C, Fu H, Liu S, Zhang H (2015) Diversity-induced multi-view subspace clustering. In: CVPR

  27. Hao W, Pang S, Yang B, Xue J (2022) Tensor-based multi-view clustering with consistency exploration and diversity regularization. Knowl-Based Syst 252:109342

    Article  Google Scholar 

  28. Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: The Thirty-Second AAAI Conference on Artificial Intelligence

  29. Cao X, Zhang C, Fu H, Liu S, Zhang H (2015) Diversity induced multi view subspace. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

  30. Ng AY, Jordan MI, Weiss Y (2001) On-spectral-clustering-analysis-and-an-algorithm. In: NIPS

  31. Afonso MV, Bioucas-Dias JM, Figueiredo MA (2011) An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems. IEEE Trans Image Process 20:681–695

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors thank the anonymous reviewers and the editor for their helpful comments and suggestions to improve the quality of this paper. This research was supported by NSFC (No. 61976005) and the Natural Science Research Project of Anhui Province University (No. 2022AH050970).

Author information

Authors and Affiliations

  1. School of Computer Science and Information, AnHui Polytechnic University, WuHu, 241000, AnHui, China

    Yaozu Kan, Gui-Fu Lu, Guangyan Ji & Yangfan Du

Authors
  1. Yaozu Kan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gui-Fu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guangyan Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yangfan Du
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gui-Fu Lu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kan, Y., Lu, GF., Ji, G. et al. Tensor low-rank representation combined with consistency and diversity exploration. Int. J. Mach. Learn. & Cyber. 15, 5173–5184 (2024). https://doi.org/10.1007/s13042-024-02224-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-024-02224-1

Keywords

Search

Navigation