Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

Unsupervised 2D dimensionality reduction by jointly learning structural and temporal correlation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Unsupervised dimensionality reduction presents one of the greatest challenges facing the machine learning community. However, as for 2-dimensional time series data processing, conventional unsupervised dimensionality reduction methods usually focus on the similarity calculation techniques through 1-dimensional (1D) feature vectors, while ignoring the underlying structural and time clues. In fact, the structural information implies the spatial relationship between objects in an image and the time information holds the temporal correlation among images, both are crucial discriminative information for unsupervised dimensionality reduction. In view of this,we appeal to take structural and temporal clues into account in unsupervised dimensionality reduction. Specifically, we derive a similarity learning model, which projects the original data space to a compact feature subspace by jointly exploring the adaptive structural and temporal clues (2d-UDRAT). Besides, a practical iterative strategy is conceived to obtain the solution of the proposed model. To verify the efficiency of our method, we take video stream as an example and elaborately design a series of comparison experiments versus several 2D unsupervised dimensionality reduction methods. The experimental results indicate that our proposed is more effective than other state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. http://www.umiacs.umd.edu/zhuolin/Keckgesturedataset.html

  2. http://www.wisdom.weizmann.ac.il/vision/SpaceTimeActions.html

  3. http://watchnpatch.cs.cornell.edu/

References

  1. Cai D, He X, Han J (2005) Document clustering using locality preserving indexing. IEEE Trans Knowl Data Eng 17(12):1624–1637

    Article  Google Scholar 

  2. Chang X, Nie F, Yang Y, Huang H (2014) A convex sparse PCA for feature analysis. CoRR arXiv:1411.6233

  3. Chang X, Yu Y L, Yi Y, Xing E P (2016) Semantic pooling for complex event analysis in untrimmed videos. IEEE Transactions on Pattern Analysis and Machine Intelligence PP(99):1617–1632

    Google Scholar 

  4. Chen W, Li C, Shao Y, Zhang J, Deng N (2019) 2drlpp: robust two-dimensional locality preserving projection with regularization. Knowl Based Syst 169:53–66. https://doi.org/10.1016/j.knosys.2019.01.022

    Article  Google Scholar 

  5. Deng C, Zhang C, He X (2010) Unsupervised feature selection for multi-cluster data. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, Washington, DC, USA

  6. Fan K (1949) On a theorem of weyl concerning eigenvalues of linear transformations i. Proc Natl Acad Sci USA 35:652–5. https://doi.org/10.1073/pnas.35.11.652

    Article  MathSciNet  Google Scholar 

  7. Gao L, Song J, Liu X, Shao J, Liu J, Shao J (2017) Learning in high-dimensional multimedia data: the state of the art. Multimedia Systems 23(3):303–313

    Article  Google Scholar 

  8. Gao Q, Ma L, Liu Y, Gao X, Nie F (2018) Angle 2dpca: a new formulation for 2dpca. IEEE Trans Cybern 48(5):1672–1678. https://doi.org/10.1109/TCYB.2017.2712740

    Article  Google Scholar 

  9. Gong D, Medioni GG, Zhu S, Zhao X (2012) Kernelized temporal cut for online temporal segmentation and recognition, pp 229–243. https://doi.org/10.1007/978-3-642-33712-3_17

  10. He X, Ji M, Zhang C, Bao H (2011) A variance minimization criterion to feature selection using laplacian regularization. IEEE Transactions on Pattern Analysis and Machine Intelligence 33. https://doi.org/10.1109/TPAMI.2011.44

  11. He X, Niyogi P (2004) Locality preserving projections. In: Thrun S, Saul LK, Schölkopf B (eds) Advances in neural information processing systems . http://papers.nips.cc/paper/2359-locality-preserving-projections.pdf, vol 16. MIT Press, pp 153–160

  12. Hu D, Feng G, Zhou Z (2008) Two-dimensional locality preserving projections (2dlpp) with its application to palmprint recognition. Pattern Recogn 40(1):339–342

    Article  Google Scholar 

  13. Hwang K, Jiang W, Chen Y, Shi H (2017) Motion segmentation and balancing for a biped robot’s imitation learning. IEEE Transactions on Industrial Informatics 13:1–1

    Article  Google Scholar 

  14. Krüger B, Vögele A, Willig T, Yao A, Klein R, Weber A (2015) Efficient unsupervised temporal segmentation of motion data. IEEE Transactions on Multimedia, 2015. https://doi.org/10.1104/pp.79.3.699

  15. Li M, Leung H (2016) Graph-based representation learning for automatic human motion segmentation. Multimedia Tools and Applications 75(15):9205–9224

    Article  Google Scholar 

  16. Na L, Feng Z, Zhao X (2013) Human motion capture data segmentation based on graph partition. In: 2013 6th International congress on image and signal processing (CISP)

  17. Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the ACM SIGKDD International conference on knowledge discovery and data mining. https://doi.org/10.1145/2623330.2623726, pp 977–986

  18. Qian C, Breckon T, Xu Z (2017) Clustering in pursuit of temporal correlation for human motion segmentation. Multimedia Tools and Applications 77:1–17. https://doi.org/10.1007/s11042-017-5408-0

    Google Scholar 

  19. Sheng L, Kang L, Yun F (2015) Temporal subspace clustering for human motion segmentation. In: 2015 IEEE International conference on computer vision (ICCV)

  20. Song J, Gao L, Nie F, Shen H, Yan Y, Sebe N (2016) Optimized graph learning using partial tags and multiple features for image and video annotation. IEEE Trans Image Process 25:1–1. https://doi.org/10.1109/TIP.2016.2601260

    Article  MathSciNet  Google Scholar 

  21. Song J, Gao L, Puscas MM, Nie F, Shen F, Sebe N (2016) Joint graph learning and video segmentation via multiple cues and topology calibration. In: Proceedings of the 2016 ACM conference on multimedia conference, MM 2016, Amsterdam, The Netherlands, October 15-19, 2016, pp 831–840. https://doi.org/10.1145/2964284.2964295

  22. Turk M, Pentland A (1991) Face recognition using eigenfaces, pp 586–591. https://doi.org/10.1109/CVPR.1991.139758

  23. Vögele A, Krüger B, Klein R (2014) Efficient unsupervised temporal segmentation of human motion. In: 2014 ACM SIGGRAPH/Eurographics symposium on computer animation

  24. Wang J (2012) Hessian locally linear embedding, pp 203–220. https://doi.org/10.1007/978-3-642-27497-8_13

  25. Wang X, Liu Y, Nie F, Huang H (2015) Discriminative unsupervised dimensionality reduction. In: Proceedings of the twenty-fourth international joint conference on artificial intelligence, IJCAI 2015, Buenos Aires, Argentina, July 25-31, 2015, pp 3925–3931. http://ijcai.org/Abstract/15/551

  26. Woraratpanya K, Sornnoi M, Leelaburanapong S, Titijaroonroj T, Varakulsiripunth R, Kuroki Y, Kato Y (2015) An improved 2dpca for face recognition under illumination effects, pp 448–452. https://doi.org/10.1109/ICITEED.2015.7408988

  27. Yang J, Zhang D, Frangi A, Yang JY (2004) Two-dimensional pca: a new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 26. https://doi.org/10.1109/TPAMI.2004.1261097

  28. Zhang D, Zhou ZH (2005) (2d)2pca: two-directional two-dimensional pca for efficient face representation and recognition. Neurocomputing 69(1-3):224–231

    Article  Google Scholar 

  29. Zhao X, Nie F, Wang S, Guo J, Xu P, Chen X (2017) Unsupervised 2d dimensionality reduction with adaptive structure learning. Neural Comput 29(5):1352–1374

    Article  MathSciNet  Google Scholar 

  30. Zhou S, Zhang D (2019) Bilateral angle 2dpca for face recognition. IEEE Signal Process Lett 26(2):317–321. https://doi.org/10.1109/LSP.2018.2889925

    Article  Google Scholar 

  31. Zhu X, Lei C, Yu H, Li Y, Gan J, Zhang S (2018) Robust graph dimensionality reduction. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI 2018, July 13-19, 2018, Stockholm, Sweden, pp 3257–3263. https://doi.org/10.24963/ijcai.2018/452

Download references

Acknowledgements

This work was supported in part by the National Science Foundation of China under Grant No.62072372, 61902318, 61973250, and the key Research and Development Program of Shaanxi Province under Grant 2019GY-012.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun Guo.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, M., Guo, J., An, J. et al. Unsupervised 2D dimensionality reduction by jointly learning structural and temporal correlation. Appl Intell 52, 5646–5656 (2022). https://doi.org/10.1007/s10489-021-02439-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02439-7

Keywords

Navigation