Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3637528.3672070acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Topology-Driven Multi-View Clustering via Tensorial Refined Sigmoid Rank Minimization

Published: 24 August 2024 Publication History

Abstract

Benefiting from the effective exploitation of the high-order correlations across multiple views, tensor-based multi-view clustering (TMVC) has garnered considerable attention in recent years. Nevertheless, prior TMVC techniques commonly involve assembling multiple view-specific spatial similarity graphs into a three-dimensional tensor, overlooking the intrinsic topological structure essential for precise clustering of data within a manifold. Additionally, mainstream techniques are constrained by equally shrinking all singular values to recover a low-rank tensor, limiting their capacity to distinguish significant variations among different singular values. In this investigation, we present an innovative TMVC framework termed toPology-driven multi-view clustering viA refined teNsorial sigmoiD rAnk minimization (PANDA ). Specifically, PANDA extracts view-specific topological structures from Euclidean graphs and intricately integrates them into a low-rank three-dimensional tensor, facilitating the concurrent utilization of intra-view topological connectivity and inter-view high-order correlations. Moreover, we develop a refined sigmoid function as the tighter surrogate to tensor rank, enabling the exploration of significant information of heterogeneous singular values. Meanwhile, the topological structures are merged into a unified structure with varying weights, associated with a connectivity constraint, empowering the significant divergence among views and the explicit cluster structure of the target graph are simultaneously leveraged. Extensive experiments demonstrate the superiority of PANDA, outperforming SOTA methods.

Supplemental Material

MP4 File - Topology-Driven Multi-View Clustering via Tensorial Refined Sigmoid Rank Minimization
Video presentation about the PANDA model

References

[1]
Dimitri Bertsekas. 1997. Nonlinear Programming. Journal of the Operational Research Society, Vol. 48, 3 (1997), 334--334.
[2]
Jie Chen, Hua Mao, Wai Lok Woo, and Xi Peng. 2023. Deep Multiview Clustering by Contrasting Cluster Assignments. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV). 16706--16715.
[3]
Man-Sheng Chen, Chang-Dong Wang, Dong Huang, Jian-Huang Lai, and Philip S. Yu. 2022. Efficient Orthogonal Multi-View Subspace Clustering. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 127--135.
[4]
Man-Sheng Chen, Chang-Dong Wang, and Jian-Huang Lai. 2023. Low-Rank Tensor Based Proximity Learning for Multi-View Clustering. IEEE Transactions on Knowledge and Data Engineering, Vol. 35, 5 (2023), 5076--5090.
[5]
Yongyong Chen, Xiaolin Xiao, and Yicong Zhou. 2020. Jointly Learning Kernel Representation Tensor and Affinity Matrix for Multi-View Clustering. IEEE Transactions on Multimedia, Vol. 22, 8 (2020), 1985--1997.
[6]
Tao Pham Dinh and Hoai An Le Thi. 1997. Convex analysis approach to d.c. programming: Theory, Algorithm and Applications. (1997).
[7]
Zhibin Dong, Siwei Wang, Jiaqi Jin, Xinwang Liu, and En Zhu. 2023. Cross-view Topology Based Consistent and Complementary Information for Deep Multi-view Clustering. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV). 19383--19394.
[8]
K Fan. 1950. On a Theorem of Weyl Concerning Eigenvalues of Linear Transformations: II. Proceedings of the National Academy of Sciences of the United States of America, Vol. 36, 1 (1950), 31--35.
[9]
Lele Fu, Zhaoliang Chen, Yongyong Chen, and Shiping Wang. 2022. Unified Low-Rank Tensor Learning and Spectral Embedding for Multi-View Subspace Clustering. IEEE Transactions on Multimedia (2022), 1--14.
[10]
Jipeng Guo, Yanfeng Sun, Junbin Gao, Yongli Hu, and Baocai Yin. 2023. Logarithmic Schatten-pp Norm Minimization for Tensorial Multi-View Subspace Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 3 (2023), 3396--3410.
[11]
Junlin Hu, Jiwen Lu, and Yap-Peng Tan. 2018. Sharable and Individual Multi-View Metric Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, 9 (2018), 2281--2288. https://doi.org/10.1109/TPAMI.2017.2749576
[12]
Aiping Huang, Tiesong Zhao, and Chia-Wen Lin. 2020. Multi-View Data Fusion Oriented Clustering via Nuclear Norm Minimization. IEEE Transactions on Image Processing, Vol. 29 (2020), 9600--9613.
[13]
Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2023. Fast Multi-view Clustering via Ensembles: Towards Scalability, Superiority, and Simplicity. IEEE Transactions on Knowledge and Data Engineering (2023), 1--16.
[14]
Jin Huang, Feiping Nie, and Heng Huang. 2015. A New Simplex Sparse Learning Model to Measure Data Similarity for Clustering. In Proceedings of the 24th International Conference on Artificial Intelligence. 3569--3575.
[15]
Shudong Huang, Yixi Liu, Ivor W. Tsang, Zenglin Xu, and Jiancheng Lv. 2022. Multi-View Subspace Clustering by Joint Measuring of Consistency and Diversity. IEEE Transactions on Knowledge and Data Engineering (2022), 1--12. https://doi.org/10.1109/TKDE.2022.3199587
[16]
Shudong Huang, Ivor Tsang, Zenglin Xu, Jiancheng Lv, and Quan-Hui Liu. 2022. Multi-View Clustering on Topological Manifold. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 6944--6951.
[17]
Shudong Huang, Ivor W. Tsang, Zenglin Xu, and Jiancheng Lv. 2022. CGDD: Multiview Graph Clustering via Cross-Graph Diversity Detection. IEEE Transactions on Neural Networks and Learning Systems (2022), 1--14.
[18]
Shudong Huang, Hongjie Wu, Yazhou Ren, Ivor Tsang, Zenglin Xu, Wentao Feng, and Jiancheng Lv. 2022 d. Multi-view Subspace Clustering on Topological Manifold. In Proceedings of the Neural Information Processing Systems. 1--12.
[19]
Xiaodong Jia, Xiao-Yuan Jing, Xiaoke Zhu, Songcan Chen, Bo Du, Ziyun Cai, Zhenyu He, and Dong Yue. 2021. Semi-Supervised Multi-View Deep Discriminant Representation Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 7 (2021), 2496--2509.
[20]
Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, and Qingfu Zhang. 2021. Multi-View Spectral Clustering Tailored Tensor Low-Rank Representation. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 12 (2021), 4784--4797.
[21]
Guangqi Jiang, Jinjia Peng, Huibing Wang, Zetian Mi, and Xianping Fu. 2022. Tensorial Multi-View Clustering via Low-Rank Constrained High-Order Graph Learning. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 32, 8 (2022), 5307--5318.
[22]
Zhao Kang, Wangtao Zhou, Zhitong Zhao, Junming Shao, Meng Han, and Zenglin Xu. 2020. Large-Scale Multi-View Subspace Clustering in Linear Time. In Proceedings of the AAAI Conference on Artificial Intelligence. 4412--4419.
[23]
Majid Komeili, Narges Armanfard, and Dimitrios Hatzinakos. 2021. Multiview Feature Selection for Single-View Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 10 (2021), 3573--3586.
[24]
Lusi Li and Haibo He. 2022. Bipartite Graph Based Multi-View Clustering. IEEE Transactions on Knowledge and Data Engineering, Vol. 34, 7 (2022), 3111--3125.
[25]
Ruihuang Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, and Zheng Wang. 2019. Flexible Multi-View Representation Learning for Subspace Clustering. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2916--2922.
[26]
Xuelong Li, Han Zhang, Rong Wang, and Feiping Nie. 2022. Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, 1 (2022), 330--344.
[27]
Youwei Liang, Dong Huang, and Chang-Dong Wang. 2019. Consistency Meets Inconsistency: A Unified Graph Learning Framework for Multi-view Clustering. In 2019 IEEE International Conference on Data Mining (ICDM). 1204--1209.
[28]
Guangcan Liu, Zhouchen Lin, Shuicheng Yan, Ju Sun, Yong Yu, and Yi Ma. 2013. Robust Recovery of Subspace Structures by Low-Rank Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, 1 (2013), 171--184.
[29]
Jiyuan Liu, Xinwang Liu, Yuexiang Yang, Qing Liao, and Yuanqing Xia. 2023. Contrastive Multi-View Kernel Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 8 (2023), 9552--9566.
[30]
Xinwang Liu. 2023. SimpleMKKM: Simple Multiple Kernel K-Means. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 4 (2023), 5174--5186.
[31]
Xinwang Liu, Miaomiao Li, Chang Tang, Jingyuan Xia, Jian Xiong, Li Liu, Marius Kloft, and En Zhu. 2021. Efficient and Effective Regularized Incomplete Multi-View Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 8 (2021), 2634--2646.
[32]
Canyi Lu, Jiashi Feng, Yudong Chen, Wei Liu, Zhouchen Lin, and Shuicheng Yan. 2016. Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimization. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 5249--5257.
[33]
Zhoumin Lu, Feiping Nie, Rong Wang, and Xuelong Li. 2023. A Differentiable Perspective for Multi-View Spectral Clustering With Flexible Extension. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 6 (2023), 7087--7098.
[34]
Hà Quang Minh, Loris Bazzani, and Vittorio Murino. 2014. A Unifying Framework in Vector-valued Reproducing Kernel Hilbert Spaces for Manifold Regularization and Co-Regularized Multi-view Learning. Journal of Machine Learning Research, Vol. 17 (2014), 1--72.
[35]
Feiping Nie, Guohao Cai, and Xuelong Li. 2017. Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 2408--2414.
[36]
Feiping Nie, Jing Li, and Xuelong Li. 2017. Self-Weighted Multiview Clustering with Multiple Graphs. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2564--2570.
[37]
Feiping Nie, Lai Tian, and Xuelong Li. 2018. Multiview Clustering via Adaptively Weighted Procrustes. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2022--2030.
[38]
Feiping Nie, Xiaoqian Wang, and Heng Huang. 2014. Clustering and Projected Clustering with Adaptive Neighbors. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 977--986.
[39]
ErLin Pan and Zhao Kang. 2021. Multi-view Contrastive Graph Clustering. In Advances in Neural Information Processing Systems, Vol. 34. 2148--2159.
[40]
Xi Peng, Zhenyu Huang, Jiancheng Lv, Hongyuan Zhu, and Joey Tianyi Zhou. 2019. COMIC: Multi-view Clustering Without Parameter Selection. In Proceedings of the 36th International Conference on Machine Learning. 5092--5101.
[41]
Wei Shen, Yang Yang, and Yinan Liu. 2022. Multi-View Clustering for Open Knowledge Base Canonicalization. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1578--1588.
[42]
Shiliang Sun, Wenbo Dong, and Qiuyang Liu. 2021. Multi-View Representation Learning With Deep Gaussian Processes. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 12 (2021), 4453--4468.
[43]
Yuze Tan, Yixi Liu, Shudong Huang, Wentao Feng, and Jiancheng Lv. 2023. Sample-Level Multi-View Graph Clustering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 23966--23975.
[44]
Chang Tang, Zhenglai Li, Jun Wang, Xinwang Liu, Wei Zhang, and En Zhu. 2023. Unified One-Step Multi-View Spectral Clustering. IEEE Transactions on Knowledge and Data Engineering, Vol. 35, 6 (2023), 6449--6460.
[45]
Chang Tang, Xinwang Liu, Xinzhong Zhu, En Zhu, Zhigang Luo, Lizhe Wang, and Wen Gao. 2020. CGD: Multi-View Clustering via Cross-View Graph Diffusion. In AAAI Conference on Artificial Intelligence. 5924--5931.
[46]
Xudong Tian, Zhizhong Zhang, Cong Wang, Wensheng Zhang, Yanyun Qu, Lizhuang Ma, Zongze Wu, Yuan Xie, and Dacheng Tao. 2023. Variational Distillation for Multi-View Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023), 1--18.
[47]
Daniel J. Trosten, Sigurd Løkse, Robert Jenssen, and Michael Kampffmeyer. 2021. Reconsidering Representation Alignment for Multi-view Clustering. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 1255--1265.
[48]
Daniel J. Trosten, Sigurd Løkse, Robert Jenssen, and Michael C. Kampffmeyer. 2023. On the Effects of Self-supervision and Contrastive Alignment in Deep Multi-view Clustering. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 23976--23985.
[49]
Hao Wang, Yan Yang, and Bing Liu. 2020. GMC: Graph-Based Multi-View Clustering. IEEE Transactions on Knowledge and Data Engineering, Vol. 32, 6 (2020), 1116--1129.
[50]
Qi Wang, Mulin Chen, and Xuelong Li. 2017. Quantifying and Detecting Collective Motion by Manifold Learning. In AAAI Conference on Artificial Intelligence. 1--13.
[51]
Jianlong Wu, Zhouchen Lin, and Hongbin Zha. 2019. Essential Tensor Learning for Multi-View Spectral Clustering. IEEE Transactions on Image Processing, Vol. 28, 12 (2019), 5910--5922.
[52]
Jianlong Wu, Xingyu Xie, Liqiang Nie, Zhouchen Lin, and Hongbin Zha. 2020. Unified Graph and Low-Rank Tensor Learning for Multi-View Clustering. In Proceedings of the AAAI Conference on Artificial Intelligence. 6388--6395.
[53]
Wei Xia, Quanxue Gao, Qianqian Wang, Xinbo Gao, Chris Ding, and Dacheng Tao. 2023. Tensorized Bipartite Graph Learning for Multi-View Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 4 (2023), 5187--5202.
[54]
Yuan Xie, Dacheng Tao, Wensheng Zhang, Yan Liu, Lei Zhang, and Yanyun Qu. 2018. On Unifying Multi-View Self-Representations for Clustering by Tensor Multi-Rank Minimization. International Journal of Computer Vision, Vol. 126 (11 2018), 1157--1179.
[55]
Jie Xu, Huayi Tang, Yazhou Ren, Liang Peng, Xiao lan Zhu, and Lifang He. 2021. Multi-level Feature Learning for Contrastive Multi-view Clustering. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 16030--16039.
[56]
Ben Yang, Xuetao Zhang, Feiping Nie, Fei Wang, Weizhong Yu, and Rong Wang. 2021. Fast Multi-View Clustering via Nonnegative and Orthogonal Factorization. IEEE Transactions on Image Processing, Vol. 30 (2021), 2575--2586.
[57]
Haizhou Yang, Quanxue Gao, Wei Xia, Ming Yang, and Xinbo Gao. 2022. Multiview Spectral Clustering With Bipartite Graph. IEEE Transactions on Image Processing, Vol. 31 (2022), 3591--3605.
[58]
Jufeng Yang, Jie Liang, Kai Wang, Paul L. Rosin, and Ming-Hsuan Yang. 2020. Subspace Clustering via Good Neighbors. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 42, 6 (2020), 1537--1544.
[59]
Mouxing Yang, Yunfan Li, Peng Hu, Jinfeng Bai, Jiancheng Lv, and Xi Peng. 2023. Robust Multi-View Clustering With Incomplete Information. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 1 (2023), 1055--1069. https://doi.org/10.1109/TPAMI.2022.3155499
[60]
Zhiyong Yang, Qianqian Xu, Weigang Zhang, Xiaochun Cao, and Qingming Huang. 2019. Split Multiplicative Multi-View Subspace Clustering. IEEE Transactions on Image Processing, Vol. 28, 10 (2019), 5147--5160.
[61]
Ming Yin, Junbin Gao, and Zhouchen Lin. 2016. Laplacian Regularized Low-Rank Representation and Its Applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 38, 3 (2016), 504--517.
[62]
Kun Zhan, Feiping Nie, Jing Wang, and Yi Yang. 2019. Multiview Consensus Graph Clustering. IEEE Transactions on Image Processing, Vol. 28, 3 (2019), 1261--1270.
[63]
Changqing Zhang, Huazhu Fu, Si Liu, Guangcan Liu, and Xiaochun Cao. 2015. Low-Rank Tensor Constrained Multiview Subspace Clustering. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV). 1582--1590.
[64]
Han Zhang, Feiping Nie, and Xuelong Li. 2023. Large-Scale Clustering With Structured Optimal Bipartite Graph. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 8 (2023), 9950--9963.
[65]
Zhenyue Zhang, Jing Wang, and Hongyuan Zha. 2012. Adaptive Manifold Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, 2 (2012), 253--265.
[66]
Handong Zhao, Zhengming Ding, and Yun Fu. 2017. Multi-View Clustering via Deep Matrix Factorization. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 2921--2927.
[67]
Guo Zhong and Chi-Man Pun. 2022. Improved Normalized Cut for Multi-View Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, 12 (2022), 10244--10251.
[68]
Pan Zhou, Canyi Lu, Jiashi Feng, Zhouchen Lin, and Shuicheng Yan. 2021. Tensor Low-Rank Representation for Data Recovery and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 5 (2021), 1718--1732.

Index Terms

  1. Topology-Driven Multi-View Clustering via Tensorial Refined Sigmoid Rank Minimization
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
    August 2024
    6901 pages
    ISBN:9798400704901
    DOI:10.1145/3637528
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 August 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. low-rank tensor representation
    2. multi-view clustering
    3. tensorial refined sigmoid rank
    4. topological manifold learning

    Qualifiers

    • Research-article

    Funding Sources

    • Beijing Natural Science Foundation

    Conference

    KDD '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 187
      Total Downloads
    • Downloads (Last 12 months)187
    • Downloads (Last 6 weeks)56
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media