Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Multiview Common Subspace Clustering via Coupled Low Rank Representation

Published: 01 August 2021 Publication History

Abstract

Multi-view subspace clustering (MVSC) finds a shared structure in latent low-dimensional subspaces of multi-view data to enhance clustering performance. Nonetheless, we observe that most existing MVSC methods neglect the diversity in multi-view data by considering only the common knowledge to find a shared structure either directly or by merging different similarity matrices learned for each view. In the presence of noise, this predefined shared structure becomes a biased representation of the different views. Thus, in this article, we propose a MVSC method based on coupled low-rank representation to address the above limitation. Our method first obtains a low-rank representation for each view, constrained to be a linear combination of the view-specific representation and the shared representation by simultaneously encouraging the sparsity of view-specific one. Then, it uses the k-block diagonal regularizer to learn a manifold recovery matrix for each view through respective low-rank matrices to recover more manifold structures from them. In this way, the proposed method can find an ideal similarity matrix by approximating clustering projection matrices obtained from the recovery structures. Hence, this similarity matrix denotes our clustering structure with exactly k connected components by applying a rank constraint on the similarity matrix’s relaxed Laplacian matrix to avoid spectral post-processing of the low-dimensional embedding matrix. The core of our idea is such that we introduce dynamic approximation into the low-rank representation to allow the clustering structure and the shared representation to guide each other to learn cleaner low-rank matrices that would lead to a better clustering structure. Therefore, our approach is notably different from existing methods in which the local manifold structure of data is captured in advance. Extensive experiments on six benchmark datasets show that our method outperforms 10 similar state-of-the-art compared methods in six evaluation metrics.

References

[1]
Avrim Blum and Tom Mitchell. 1998. Combining labeled and unlabeled data with co-training. In Proceedings of the 11th Conference on Computational Learning Theory. 92–100.
[2]
Maria Brbić and Ivica Kopriva. 2018. Multi-view low-rank sparse subspace clustering. Pattern Recog. 73 (2018), 247–258.
[3]
Jian-Feng Cai, Emmanuel J. Candès, and Zuowei Shen. 2010. A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20, 4 (2010), 1956–1982.
[4]
Xiao Cai, Feiping Nie, and Heng Huang. 2013. Multi-view k-means clustering on big data. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Citeseer.
[5]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 586–594.
[6]
João Paulo Costeira and Takeo Kanade. 1998. A multibody factorization method for independently moving objects. Int. J. Comput. Vis. 29, 3 (1998), 159–179.
[7]
Zhengming Ding and Yun Fu. 2014. Low-rank common subspace for multi-view learning. In Proceedings of the IEEE International Conference on Data Mining. IEEE, 110–119.
[8]
Zhengming Ding and Yun Fu. 2016. Robust multi-view subspace learning through dual low-rank decompositions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. 1181–1187.
[9]
Ehsan Elhamifar and René Vidal. 2009. Sparse subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2790–2797.
[10]
Ehsan Elhamifar and Rene Vidal. 2013. Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 11 (2013), 2765–2781.
[11]
Ky Fan. 1950. On a theorem of Weyl concerning eigenvalues of linear transformations: II. Proc. Nat. Acad. Sci. United States Amer. 36, 1 (1950), 31.
[12]
Hongchang Gao, Feiping Nie, Xuelong Li, and Heng Huang. 2015. Multi-view subspace clustering. In Proceedings of the IEEE International Conference on Computer Vision. 4238–4246.
[13]
Amit Gruber and Yair Weiss. 2004. Multibody factorization with uncertainty and missing data using the EM algorithm. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, I–I.
[14]
Jipeng Guo, Wenbin Yin, Yanfeng Sun, and Yongli Hu. 2019. Multi-view subspace clustering with block diagonal representation. IEEE Access 7 (2019), 84829–84838.
[15]
Yao Hu, Debing Zhang, Jieping Ye, Xuelong Li, and Xiaofei He. 2012. Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans. Pattern Anal. Mach. Intell. 35, 9 (2012), 2117–2130.
[16]
Zhenyu Huang, Joey Tianyi Zhou, Xi Peng, Changqing Zhang, Hongyuan Zhu, and Jiancheng Lv. 2019. Multi-view spectral clustering network. In Proceedings of the International Joint Conference on Artificial Intelligence. 2563–2569.
[17]
Wen Jie, Xu Yong, and Liu Hong. 2020. Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans. Cybern. 50, 4 (2020).
[18]
Ken-ichi Kanatani. 2001. Motion segmentation by subspace separation and model selection. In Proceedings of the 8th IEEE International Conference on Computer Vision. IEEE, 586–591.
[19]
Abhishek Kumar and Hal Daumé. 2011. A co-training approach for multi-view spectral clustering. In Proceedings of the 28th International Conference on Machine Learning (ICML’11). 393–400.
[20]
Abhishek Kumar, Piyush Rai, and Hal Daume. 2011. Co-regularized multi-view spectral clustering. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1413–1421.
[21]
Chun-Guang Li, Chong You, and René Vidal. 2017. Structured sparse subspace clustering: A joint affinity learning and subspace clustering framework. IEEE Trans. Image Process. 26, 6 (2017), 2988–3001.
[22]
Ruihuang Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, and Zheng Wang. 2019. Flexible multi-view representation learning for subspace clustering. In Proceedings of the International Joint Conference on Artificial Intelligence. 2916–2922.
[23]
Sheng Li, Ming Shao, and Yun Fu. 2018. Multi-view low-rank analysis with applications to outlier detection. ACM Trans. Knowl. Discov. Data 12, 3 (2018), 1–22.
[24]
Yeqing Li, Feiping Nie, Heng Huang, and Junzhou Huang. 2015. Large-scale multi-view spectral clustering via bipartite graph. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2750–2756.
[25]
Zhouchen Lin, Minming Chen, and Yi Ma. 2010. The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv preprint arXiv:1009.5055 (2010).
[26]
Guangcan Liu, Zhouchen Lin, Shuicheng Yan, Ju Sun, Yong Yu, and Yi Ma. 2013. Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1 (2013), 171–184.
[27]
Guangcan Liu, Zhouchen Lin, and Yong Yu. 2010. Robust subspace segmentation by low-rank representation. In Proceedings of the 27th International Conference on Machine Learning (ICML’10). 663–670.
[28]
Tianchi Liu, Chamara Kasun Liyanaarachchi Lekamalage, Guang-Bin Huang, and Zhiping Lin. 2018. An adaptive graph learning method based on dual data representations for clustering. Pattern Recog. 77 (2018), 126–139.
[29]
Canyi Lu, Jiashi Feng, Zhouchen Lin, Tao Mei, and Shuicheng Yan. 2018. Subspace clustering by block diagonal representation. IEEE Trans. Pattern Anal. Mach. Intell. 41, 2 (2018), 487–501.
[30]
Canyi Lu, Jiashi Feng, Zhouchen Lin, and Shuicheng Yan. 2013. Correlation adaptive subspace segmentation by trace lasso. In Proceedings of the IEEE International Conference on Computer Vision. 1345–1352.
[31]
Yi Ma, Allen Y. Yang, Harm Derksen, and Robert Fossum. 2008. Estimation of subspace arrangements with applications in modeling and segmenting mixed data. SIAM Rev. 50, 3 (2008), 413–458.
[32]
Behrooz Nasihatkon and Richard Hartley. 2011. Graph connectivity in sparse subspace clustering. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 2137–2144.
[33]
Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 849–856.
[34]
Feiping Nie, Jing Li, Xuelong Li et al. 2017. Self-weighted multiview clustering with multiple graphs. In Proceedings of the International Joint Conference on Artificial Intelligence. 2564–2570.
[35]
Feiping Nie, Xiaoqian Wang, Michael I. Jordan, and Heng Huang. 2016. The constrained Laplacian rank algorithm for graph-based clustering. In Proceedings of the AAAI Conference on Artificial Intelligence. Citeseer, 1969–1976.
[36]
Xi Peng, Zhenyu Huang, Jiancheng Lv, Hongyuan Zhu, and Joey Tianyi Zhou. 2019. COMIC: Multi-view clustering without parameter selection. In Proceedings of the International Conference on Machine Learning. PMLR, 5092–5101.
[37]
Shankar R. Rao, Allen Y. Yang, S. Shankar Sastry, and Yi Ma. 2010. Robust algebraic segmentation of mixed rigid-body and planar motions from two views. Int. J. Comput. Vis. 88, 3 (2010), 425–446.
[38]
Mark Schmidt. 2005. Least squares optimization with L1-norm regularization. CS542B Project Report 504 (2005), 195–221.
[39]
Chang Tang, Xinwang Liu, Xinzhong Zhu, En Zhu, Zhigang Luo, Lizhe Wang, and Wen Gao. 2020. CGD: Multi-view clustering via cross-view graph diffusion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 5924–5931.
[40]
Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, Jing Zhang, Jian Xiong, and Lizhe Wang. 2021. Cross-view locality preserved diversity and consensus learning for multi-view unsupervised feature selection. IEEE Trans. Knowl. Data Eng.
[41]
Chang Tang, Xinzhong Zhu, Xinwang Liu, Miaomiao Li, Pichao Wang, Changqing Zhang, and Lizhe Wang. 2019. Learning a joint affinity graph for multiview subspace clustering. IEEE Trans. Multimedia 21, 7 (2019), 1724–1736.
[42]
Hong Tao, Chenping Hou, Xinwang Liu, Tongliang Liu, Dongyun Yi, and Jubo Zhu. 2018. Reliable multi-view clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
[43]
Zhiqiang Tao, Hongfu Liu, Sheng Li, Zhengming Ding, and Yun Fu. 2020. Marginalized multiview ensemble clustering. IEEE Trans. Neural Netw. Learn. Syst. 31, 2 (2020), 600–611.
[44]
Rene Vidal, Yi Ma, and Shankar Sastry. 2005. Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. 27, 12 (2005), 1945–1959.
[45]
Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Statist. Comput. 17, 4 (2007), 395–416.
[46]
Hao Wang, Yan Yang, and Bing Liu. 2020. GMC: Graph-based multi-view clustering. IEEE Trans. Knowl. Data Eng. 32, 6 (2020), 1116–1129.
[47]
Qi Wang, Mulin Chen, Feiping Nie, and Xuelong Li. 2020. Detecting coherent groups in crowd scenes by multiview clustering. IEEE Trans. Pattern Anal. Mach. Intell. 42, 1 (2020), 46–58.
[48]
Qi Wang, Xiang He, Xu Jiang, and Xuelong Li. 2020. Robust bi-stochastic graph regularized matrix factorization for data clustering. IEEE Trans. Pattern Anal. Mach. Intell.
[49]
Yang Wang, Lin Wu, Xuemin Lin, and Junbin Gao. 2018. Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans. Neural Netw. Learn. Syst. 29, 10 (2018), 4833–4843.
[50]
Yu-Xiang Wang, Huan Xu, and Chenlei Leng. 2013. Provable subspace clustering: When LRR meets SSC. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 64–72.
[51]
Rongkai Xia, Yan Pan, Lei Du, and Jian Yin. 2014. Robust multi-view spectral clustering via low-rank and sparse decomposition. In Proceedings of the 28th AAAI Conference on Artificial Intelligence. 2149–2155.
[52]
Xingyu Xie, Xianglin Guo, Guangcan Liu, and Jun Wang. 2017. Implicit block diagonal low-rank representation. IEEE Trans. Image Process. 27, 1 (2017), 477–489.
[53]
Zhiyong Yang, Qianqian Xu, Weigang Zhang, Xiaochun Cao, and Qingming Huang. 2019. Split multiplicative multi-view subspace clustering. IEEE Trans. Image Process. 28, 10 (2019), 5147–5160.
[54]
Kun Zhan, Feiping Nie, Jing Wang, and Yi Yang. 2018. Multiview consensus graph clustering. IEEE Trans. Image Process. 28, 3 (2018), 1261–1270.
[55]
Changqing Zhang, Huazhu Fu, Si Liu, Guangcan Liu, and Xiaochun Cao. 2015. Low-rank tensor constrained multiview subspace clustering. In Proceedings of the IEEE International Conference on Computer Vision. 1582–1590.
[56]
Changqing Zhang, Qinghua Hu, Huazhu Fu, Pengfei Zhu, and Xiaochun Cao. 2017. Latent multi-view subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4279–4287.
[57]
Debing Zhang, Yao Hu, Jieping Ye, Xuelong Li, and Xiaofei He. 2012. Matrix completion by truncated nuclear norm regularization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2192–2199.
[58]
Jing Zhang and Dacheng Tao. 2021. Empowering things with intelligence: A survey of the progress, challenges, and opportunities in artificial intelligence of things. IEEE Internet Things J. 8, 10 (2021).
[59]
Zheng Zhang, Li Liu, Fumin Shen, Heng Tao Shen, and Ling Shao. 2018. Binary multi-view clustering. IEEE Trans. Pattern Anal. Mach. Intell. 41, 7 (2018), 1774–1782.
[60]
Hong Zhou and Yonghuai Liu. 2008. Accurate integration of multi-view range images using k-means clustering. Pattern Recog. 41, 1 (2008), 152–175.
[61]
Tao Zhou, Changqing Zhang, Xi Peng, Harish Bhaskar, and Jie Yang. 2020. Dual shared-specific multiview subspace clustering. IEEE Trans. Cyber. 50, 8 (2020), 2168–2267.

Cited By

View all
  • (2024)Adaptive Pruning of Channel Spatial Dependability in Convolutional Neural NetworksProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681419(6073-6082)Online publication date: 28-Oct-2024
  • (2024)Consensus Affinity Graph Learning via Structure Graph Fusion and Block Diagonal Representation for Multiview ClusteringNeural Processing Letters10.1007/s11063-024-11589-x56:2Online publication date: 8-Apr-2024
  • (2024)Image restoration via combining a fractional order variational filter and a TGV penaltyMultimedia Tools and Applications10.1007/s11042-023-17774-983:21(60393-60418)Online publication date: 5-Jan-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 12, Issue 4
August 2021
368 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3468075
  • Editor:
  • Huan Liu
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2021
Accepted: 01 May 2021
Revised: 01 April 2021
Received: 01 December 2020
Published in TIST Volume 12, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Multiview low-rank representation
  2. multiview subspace clustering
  3. adaptive clustering structure
  4. block diagonal

Qualifiers

  • Research-article
  • Refereed

Funding Sources

  • National Natural Science Foundation of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)1
Reflects downloads up to 24 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Adaptive Pruning of Channel Spatial Dependability in Convolutional Neural NetworksProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681419(6073-6082)Online publication date: 28-Oct-2024
  • (2024)Consensus Affinity Graph Learning via Structure Graph Fusion and Block Diagonal Representation for Multiview ClusteringNeural Processing Letters10.1007/s11063-024-11589-x56:2Online publication date: 8-Apr-2024
  • (2024)Image restoration via combining a fractional order variational filter and a TGV penaltyMultimedia Tools and Applications10.1007/s11042-023-17774-983:21(60393-60418)Online publication date: 5-Jan-2024
  • (2023)Hyper-Laplacian Regularized Multi-View Clustering with Exclusive L21 Regularization and Tensor Log-Determinant Minimization ApproachACM Transactions on Intelligent Systems and Technology10.1145/358703414:3(1-29)Online publication date: 13-Apr-2023
  • (2023)Incomplete Multi-View Clustering with Regularized Hierarchical GraphProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612241(3060-3068)Online publication date: 26-Oct-2023
  • (2023)Semi-supervised Multi-view Clustering Based on Non-negative Matrix Factorization and Low-Rank Tensor RepresentationNeural Processing Letters10.1007/s11063-023-11260-x55:6(7273-7292)Online publication date: 6-Apr-2023
  • (2023)Recovering Clean Data with Low Rank Structure by Leveraging Pre-learned Dictionary for Structured NoiseNeural Processing Letters10.1007/s11063-023-11164-w55:5(6865-6885)Online publication date: 20-Feb-2023
  • (2023)Spectral type subspace clustering methods: multi-perspective analysisMultimedia Tools and Applications10.1007/s11042-023-16846-083:16(47455-47475)Online publication date: 27-Oct-2023
  • (2023)Low rank and sparse decomposition based on extended $${LL}_{p}$$ normMultimedia Tools and Applications10.1007/s11042-023-16584-383:9(26107-26130)Online publication date: 28-Aug-2023
  • (2023)Robust multiview spectral clustering via cooperative manifold and low rank representation inducedMultimedia Tools and Applications10.1007/s11042-023-14557-082:16(24445-24464)Online publication date: 27-Feb-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media