Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Learning with Euler Collaborative Representation for Robust Pattern Analysis

Published: 14 November 2023 Publication History

Abstract

The Collaborative Representation (CR) framework has provided various effective and efficient solutions to pattern analysis. By leveraging between discriminative coefficient coding (l2 regularization) and the best reconstruction quality (collaboration), the CR framework can exploit discriminative patterns efficiently in high-dimensional space. Due to the limitations of its linear representation mechanism, the CR must sacrifice its superior efficiency for capturing the non-linear information with the kernel trick. Besides this, even if the coding is indispensable, there is no mechanism designed to keep the CR free from inevitable noise brought by real-world information systems. In addition, the CR only emphasizes exploiting discriminative patterns on coefficients rather than on the reconstruction. To tackle the problems of primitive CR with a unified framework, in this article we propose the Euler Collaborative Representation (E-CR) framework. Inferred from the Euler formula, in the proposed method, we map the samples to a complex space to capture discriminative and non-linear information without the high-dimensional hidden kernel space. Based on the proposed E-CR framework, we form two specific classifiers: the Euler Collaborative Representation based Classifier (E-CRC) and the Euler Probabilistic Collaborative Representation based Classifier (E-PROCRC). Furthermore, we specifically designed a robust algorithm for E-CR (termed as R-E-CR) to deal with the inevitable noises in real-world systems. Robust iterative algorithms have been specially designed for solving E-CRC and E-PROCRC. We correspondingly present a series of theoretical proofs to ensure the completeness of the theory for the proposed robust algorithms. We evaluated E-CR and R-E-CR with various experiments to show its competitive performance and efficiency.

Supplementary Material

3625235.app (3625235.app.pdf)
Supplementary material

References

[1]
Sawsan AbdulRahman, Hanine Tout, Hakima Ould-Slimane, Azzam Mourad, Chamseddine Talhi, and Mohsen Guizani. 2020. A survey on federated learning: The journey from centralized to distributed on-site learning and beyond. IEEE Internet of Things Journal 8, 7 (2020), 5476–5497.
[2]
Naveed Akhtar, Faisal Shafait, and Ajmal Mian. 2017. Efficient classification with sparsity augmented collaborative representation. Pattern Recognition 65 (2017), 136–145.
[3]
Sijia Cai, Lei Zhang, Wangmeng Zuo, and Xiangchu Feng. 2016. A probabilistic collaborative representation based approach for pattern classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2950–2959.
[4]
Weihong Deng, Jiani Hu, and Jun Guo. 2017. Face recognition via collaborative representation: Its discriminant nature and superposed representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 10 (2017), 2513–2521.
[5]
Yuan Gao, Jiayi Ma, and Alan L. Yuille. 2017. Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Transactions on Image Processing 26, 5 (2017), 2545–2560.
[6]
Meng Hao, Hongwei Li, Xizhao Luo, Guowen Xu, Haomiao Yang, and Sen Liu. 2019. Efficient and privacy-enhanced federated learning for industrial artificial intelligence. IEEE Transactions on Industrial Informatics 16, 10 (2019), 6532–6542.
[7]
Kevin Hsieh, Amar Phanishayee, Onur Mutlu, and Phillip Gibbons. 2020. The non-iid data quagmire of decentralized machine learning. In Proceedings of the International Conference on Machine Learning. 4387–4398.
[8]
Yanxin Hu, Yun Liu, Shubo Lv, Mengtao Xing, Shimin Zhang, Yihui Fu, Jian Wu, Bihong Zhang, and Lei Xie. 2020. DCCRN: Deep complex convolution recurrent network for phase-aware speech enhancement. arXiv:2008.00264 (2020).
[9]
Konstantinos Koutroumbas and Sergios Theodoridis. 2008. Pattern Recognition. Academic Press.
[10]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436–444.
[11]
Bin Li, Tian-Tsong Ng, Xiaolong Li, Shunquan Tan, and Jiwu Huang. 2015. Statistical model of JPEG noises and its application in quantization step estimation. IEEE Transactions on Image Processing 24, 5 (2015), 1471–1484.
[12]
Xili Dai, Mingyang Li, Pengyuan Zhai, Shengbang Tong, Xingjian Gao, Shao-Lun Huang, Zhihui Zhu, Chong You, and Yi Ma. 2022. Revisiting sparse convolutional model for visual recognition. Advances in Neural Information Processing Systems 35 (2022), 10492–10504.
[13]
Yun Li, Kiam Heong Ang, and Gregory C. Y. Chong. 2006. PID control system analysis and design. IEEE Control Systems Magazine 26, 1 (2006), 32–41.
[14]
Yang Liu, Quanxue Gao, Jungong Han, and Shujian Wang. 2018. Euler sparse representation for image classification. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
[15]
Stephan Liwicki, Georgios Tzimiropoulos, Stefanos Zafeiriou, and Maja Pantic. 2013. Euler principal component analysis. International Journal of Computer Vision 101, 3 (2013), 498–518.
[16]
S. A. Nane, S. K. Nayar, and H. Murase. 1996. Columbia Object Image Library: COIL-20. Technical Report. Department of Computer Science, Columbia University.
[17]
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y. Ng. 2011. Reading digits in natural images with unsupervised feature learning. In Proceedings of the 2011 NIPS Workshop on Deep Learning and Unsupervised Feature Learning (NIPS ’05 Workshop). IEEE, Los Alamitos, CA.
[18]
Hieu V. Nguyen and Li Bai. 2010. Cosine similarity metric learning for face verification. In Proceedings of the Asian Conference on Computer Vision. 709–720.
[19]
Jeng-Shyang Pan, Xiaopeng Wang, Qingxiang Feng, and Shu-Chuan Chu. 2020. A kernel-based probabilistic collaborative representation for face recognition. IEEE Access 8 (2020), 37946–37957.
[20]
Markus Schedl, Yi-Hsuan Yang, and Perfecto Herrera-Boyer. 2016. Introduction to intelligent music systems and applications. ACM Transactions on Intelligent Systems and Technology 8, 2 (2016), Article 17, 8 pages.
[21]
John Shawe-Taylor and Nello Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press.
[22]
Ting Shu, Bob Zhang, and Yuan Yan Tang. 2018. An improved noninvasive method to detect diabetes mellitus using the probabilistic collaborative representation based classifier. Information Sciences 467 (2018), 477–488.
[23]
Yimao Sun, K. C. Ho, and Qun Wan. 2020. Eigenspace solution for AOA localization in modified polar representation. IEEE Transactions on Signal Processing 68 (2020), 2256–2271.
[24]
Carlos Eduardo Thomaz and Gilson Antonio Giraldi. 2010. A new ranking method for principal components analysis and its application to face image analysis. Image and Vision Computing 28, 6 (2010), 902–913.
[25]
Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang, Dmitriy Serdyuk, Sandeep Subramanian, Joao Felipe Santos, Soroush Mehri, Negar Rostamzadeh, Yoshua Bengio, and Christopher J. Pal. 2018. Deep complex networks. In Proceedings of the International Conference on Learning Representations.
[26]
Xiaoguang Tu, Zheng Ma, Jian Zhao, Guodong Du, Mei Xie, and Jiashi Feng. 2020. Learning generalizable and identity-discriminative representations for face anti-spoofing. ACM Transactions on Intelligent Systems and Technology 11, 5 (2020), 1–19.
[27]
Dixon Vimalajeewa, Chamil Kulatunga, Donagh P. Berry, and Sasitharan Balasubramaniam. 2021. A service-based joint model used for distributed learning: Application for smart agriculture. IEEE Transactions on Emerging Topics in Computing 10, 2 (2021), 838–854.
[28]
Biao Wang, Weifeng Li, Norman Poh, and Qingmin Liao. 2013. Kernel collaborative representation-based classifier for face recognition. In Proceedings of the 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing. IEEE, Los Alamitos, CA, 2877–2881.
[29]
Guancheng Wang, Zhihao Hao, Bob Zhang, Leyuan Fang, and Dianhui Mao. 2022. A robust Newton iterative algorithm for acoustic location based on solving linear matrix equations in the presence of various noises. Applied Intelligence 53, 1 (2022), 1–14.
[30]
Xiaogang Wang and Xiaoou Tang. 2006. Random sampling for subspace face recognition. International Journal of Computer Vision 70, 1 (2006), 91–104.
[31]
John Wright, Allen Y. Yang, Arvind Ganesh, S. Shankar Sastry, and Yi Ma. 2008. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 2 (2008), 210–227.
[32]
Han Xiao, Kashif Rasul, and Roland Vollgraf. 2017. Fashion-MNIST: A Novel Image Dataset for Benchmarking Machine Learning Algorithms. arXiv:cs.LG/1708.07747 [cs.LG] (2017).
[33]
Jun Xu, Wangpeng An, Lei Zhang, and David Zhang. 2019. Sparse, collaborative, or nonnegative representation: Which helps pattern classification? Pattern Recognition 88 (2019), 679–688.
[34]
Yong Xu, David Zhang, Jian Yang, and Jing-Yu Yang. 2011. A two-phase test sample sparse representation method for use with face recognition. IEEE Transactions on Circuits and Systems for Video Technology 21, 9 (2011), 1255–1262.
[35]
Yong Xu, Qi Zhu, Zizhu Fan, David Zhang, Jianxun Mi, and Zhihui Lai. 2013. Using the idea of the sparse representation to perform coarse-to-fine face recognition. Information Sciences 238 (2013), 138–148.
[36]
Shaoning Zeng, Bob Zhang, Jianping Gou, and Yong Xu. 2022. Regularization on augmented data to diversify sparse representation for robust image classification. IEEE Transactions on Cybernetics 52, 6 (2022), 4935–4948.
[37]
Shaoning Zeng, Bob Zhang, Yanghao Zhang, and Jianping Gou. 2018. Collaboratively weighting deep and classic representation via \(l\_2\) regularization for image classification. In Proceedings of the Asian Conference on Machine Learning. 502–517.
[38]
David Zhang and Wangmeng Zuo. 2016. Medical Biometrics: Computerized TCM Data Analysis. World Scientific.
[39]
Lei Zhang, Meng Yang, and Xiangchu Feng. 2011. Sparse representation or collaborative representation: Which helps face recognition? In Proceedings of the 2011 International Conference on Computer Vision. IEEE, Los Alamitos, CA, 471–478.
[40]
Li Zhang, Wei-Da Zhou, Pei-Chann Chang, Jing Liu, Zhe Yan, Ting Wang, and Fan-Zhang Li. 2011. Kernel sparse representation-based classifier. IEEE Transactions on Signal Processing 60, 4 (2011), 1684–1695.
[41]
Qi Zhang, Jianhang Zhou, and Bob Zhang. 2021. Computational traditional Chinese medicine diagnosis: A literature survey. Computers in Biology and Medicine 133 (2021), 104358.
[42]
Shuping Zhao and Bob Zhang. 2020. Learning complete and discriminative direction pattern for robust palmprint recognition. IEEE Transactions on Image Processing 30 (2020), 1001–1014.
[43]
Shuping Zhao, Bob Zhang, and C. L. Philip Chen. 2019. Joint deep convolutional feature representation for hyperspectral palmprint recognition. Information Sciences 489 (2019), 167–181.
[44]
Jianhang Zhou, Shaoning Zeng, and Bob Zhang. 2020. Linear representation-based methods for image classification: A survey. IEEE Access 8 (2020), 216645–216670.
[45]
Jianhang Zhou, Shaoning Zeng, and Bob Zhang. 2020. Two-stage knowledge transfer framework for image classification. Pattern Recognition 107 (2020), 107529.
[46]
Jianhang Zhou and Bob Zhang. 2019. Collaborative representation using non-negative samples for image classification. Sensors 19, 11 (2019), 2609.

Cited By

View all
  • (2024)An elastic competitive and discriminative collaborative representation method for image classificationNeural Networks10.1016/j.neunet.2024.106231174:COnline publication date: 1-Jun-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 6
December 2023
493 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3632517
  • Editor:
  • Huan Liu
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2023
Online AM: 26 September 2023
Accepted: 01 September 2023
Revised: 28 July 2023
Received: 17 November 2022
Published in TIST Volume 14, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Euler space
  2. collaborative representation
  3. pattern analysis
  4. robustness

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • Open Research Fund of the Beijing Key Laboratory of Big Data Technology for Food Safety

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)120
  • Downloads (Last 6 weeks)2
Reflects downloads up to 30 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)An elastic competitive and discriminative collaborative representation method for image classificationNeural Networks10.1016/j.neunet.2024.106231174:COnline publication date: 1-Jun-2024

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media