rapid-communication

Robust multi-view fuzzy clustering via softmin

Authors:

Hongyuan Zhang,

Yueshen XuAuthors Info & Claims

Volume 458, Issue C

Pages 47 - 55

https://doi.org/10.1016/j.neucom.2021.06.011

Published: 11 October 2021 Publication History

Abstract

Multi-view clustering, which utilizes the ample information provided by multiple sources to obtain better performance, has attracted much attention. However, existing clustering algorithms either have no ability to offer confidence for each assignment or suffer from the disturbance of outliers. To address these problems, in this paper, we propose a novel multi-view fuzzy clustering method via transferring softmin to fuzzy models. To obtain fuzzy assignments, we utilize the softmin with temperature and further develop an efficient algorithm to solve the non-convex problem approximately. We also show another explanation for the algorithm from the aspect of the prior distribution of various views. Besides, we design a scalable robust loss function, which interpolates between ℓ₂-norm and the squared ℓ₂-norm, to enhance the robustness to outliers. Extensive experiments show the superiority of our model under different clustering metrics.

References

[1]

W. Zhu, F. Nie, X. Li, Fast spectral clustering with efficient large graph construction, in: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2017, pp. 2492–2496.

[2]

R. Liu, M. Chen, Q. Wang, X. Li, Robust rank constrained sparse learning: A graph-based method for clustering, in: ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2020, pp. 4217–4221.

[3]

D. Wu, F. Nie, R. Wang, X. Li, Multi-view clustering via mixed embedding approximation, in: ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, 2020, pp. 3977–3981.

[4]

J. Dunn, A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters, Journal of Cybernetics 3 (3) (1973) 32–57.

[5]

S. Miyamoto, M. Mukaidono, Fuzzy c-means as a regularization and maximum entropy approach, in: Proceedings of the Seventh International Fuzzy Systems Association World Congress, 1997, pp. 86–92.

[6]

M.J. Li, M.K. Ng, Y.-M. Cheung, J.Z. Huang, Agglomerative fuzzy k-means clustering algorithm with selection of number of clusters, IEEE Transactions on Knowledge and Data Engineering 20 (11) (2008) 1519–1534.

Digital Library

[7]

X. Li, H. Zhang, R. Zhang, Adaptive graph auto-encoder for general data clustering, arXiv preprint arXiv:2002.08648.

[8]

X. Li, H. Zhang, R. Zhang, Embedding graph auto-encoder with joint clustering via adjacency sharing, arXiv preprint arXiv:2002.08643.

[9]

R. Zhang, X. Li, H. Zhang, F. Nie, Deep fuzzy k-means with adaptive loss and entropy regularization, IEEE Transactions on Fuzzy Systems 28 (11) (2020) 2814–2824.

[10]

W. Liu, Z. Wang, X. Liu, N. Zeng, D. Bell, A novel particle swarm optimization approach for patient clustering from emergency departments, IEEE Transactions on Evolutionary Computation 23 (4) (2019) 632–644,.

[11]

N. Zeng, Z. Wang, H. Zhang, K.-E. Kim, Y. Li, X. Liu, An improved particle filter with a novel hybrid proposal distribution for quantitative analysis of gold immunochromatographic strips, IEEE Transactions on Nanotechnology 18 (2019) 819–829,.

Digital Library

[12]

N. Zeng, Z. Wang, W. Liu, H. Zhang, K. Hone, X. Liu, A dynamic neighborhood-based switching particle swarm optimization algorithm, IEEE Transactions on Cybernetics (2020) 1–12,.

[13]

N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: International Conference on Computer Vision & Pattern Recognition (CVPR’05), vol. 1, IEEE Computer Society, 2005, pp. 886–893.

[14]

T. Ojala, M. Pietikäinen, T. Mäenpää, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on Pattern Analysis & Machine Intelligence 24 (7) (2002) 971–987.

[15]

D.G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision 60 (2) (2004) 91–110.

Digital Library

[16]

V. Ojansivu, J. Heikkilä, Blur insensitive texture classification using local phase quantization, in: International Conference on Image and Signal Processing, Springer, 2008, pp. 236–243.

[17]

X. Cai, F. Nie, H. Huang, Multi-view k-means clustering on big data, in: Twenty-Third International Joint Conference on Artificial Intelligence, 2013.

[18]

G. Cleuziou, M. Exbrayat, L. Martin, J. Sublemontier, Cofkm: A centralized method for multiple-view clustering, in: 2009 Ninth IEEE International Conference on Data Mining, 2009, pp. 752–757,.

Digital Library

[19]

F. Nie, L. Tian, X. Li, Multiview clustering via adaptively weighted procrustes, in: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2018, pp. 2022–2030.

[20]

Y. Wang, L. Chen, Multi-view fuzzy clustering with minimax optimization for effective clustering of data from multiple sources, Expert Systems with Applications 72 (2017) 457–466.

[21]

H. Gao, F. Nie, X. Li, H. Huang, Multi-view subspace clustering, in: IEEE International Conference on Computer Vision, 2016, pp. 4238–4246.

[22]

R. Zhang, H. Zhang, X. Li, Maximum joint probability with multiple representations for clustering, IEEE Transactions on Neural Networks and Learning Systems (2021) 1–11,.

[23]

Y. Jiang, F. Chung, S. Wang, Z. Deng, J. Wang, P. Qian, Collaborative fuzzy clustering from multiple weighted views, IEEE Transactions on Cybernetics 45 (4) (2015) 688–701.

[24]

E.H. Ruspini, A new approach to clustering, Information and Control 15 (1) (1969) 22–32.

[25]

R. Zhang, F. Nie, M. Guo, X. Wei, X. Li, Joint learning of fuzzy k-means and nonnegative spectral clustering with side information, IEEE Transactions on Image Processing 28 (5) (2019) 2152–2162.

[26]

X. Li, R. Zhang, Q. Wang, H. Zhang, Autoencoder Constrained Clustering With Adaptive Neighbors, IEEE Transactions on Neural Networks and Learning Systems 32 (1) (2020) 443–449.

[27]

J. Xu, J. Han, K. Xiong, F. Nie, Robust and sparse fuzzy k-means clustering, in: IJCAI, 2016, pp. 2224–2230.

[28]

F. Nie, X. Wang, H. Huang, Clustering and projected clustering with adaptive neighbors, in: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, pp. 977–986.

[29]

G. Tzortzis, A. Likas, Kernel-based weighted multi-view clustering, in: 2012 IEEE 12th International Conference on Data Mining, IEEE, 2012, pp. 675–684.

[30]

F. Nie, G. Cai, X. Li, Multi-view clustering and semi-supervised classification with adaptive neighbours, in: Thirty-First AAAI Conference on Artificial Intelligence, 2017.

[31]

H. Wang, F. Nie, H. Huang, Multi-view clustering and feature learning via structured sparsity, in: International Conference on Machine Learning, 2013, pp. 352–360.

[32]

L. Tian, F. Nie, X. Li, A unified weight learning paradigm for multi-view learning, in: The 22nd International Conference on Artificial Intelligence and Statistics, 2019, pp. 2790–2800.

[33]

G. Hinton, O. Vinyals, J. Dean, Distilling the knowledge in a neural network, arXiv preprint arXiv:1503.02531.

[34]

F. Nie, W. Hua, H. Huang, C. Ding, Adaptive loss minimization for semi-supervised elastic embedding, in: International Joint Conference on Artificial Intelligence, 2013, pp. 1565–1571.

[35]

D. Cai, C. Zhang, X. He, Unsupervised feature selection for multi-cluster data, in: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010, pp. 333–342.

Digital Library

[36]

J.M. Winn, N. Jojic, Locus, Learning object classes with unsupervised segmentation, in: Proc International Conference on Computer Vision, 2005, pp. 756–763.

[37]

F.F. Li, R. Fergus, P. Perona, Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories, in: Conference on Computer Vision & Pattern Recognition Workshop, 2004, pp. 59–70.

[38]

A. Oliva, A. Torralba, Modeling the shape of the scene: A holistic representation of the spatial envelope, International Journal of Computer Vision 42 (3) (2001) 145–175.

Digital Library

[39]

J. Wu, J.M. Rehg, Where am i: Place instance and category recognition using spatial pact, in: IEEE Conference on Computer Vision & Pattern Recognition, 2008.

[40]

D.G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision 60 (2) (2004) 91–110.

Digital Library

Cited By

Hu DDong ZLiang KYu HWang SLiu X(2024)High-order Topology for Deep Single-Cell Multiview Fuzzy ClusteringIEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2024.339974032:8(4448-4459)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TFUZZ.2024.3399740
P. Branco DT. de Carvalho F(2023)Medoid based semi-supervised fuzzy clustering algorithms for multi-view relational dataFuzzy Sets and Systems10.1016/j.fss.2023.108630469:COnline publication date: 15-Oct-2023
https://dl.acm.org/doi/10.1016/j.fss.2023.108630
Wei HChen LChen CDuan JHan RGuo L(2022)Fuzzy clustering for multiview data by combining latent informationApplied Soft Computing10.1016/j.asoc.2022.109140126:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.asoc.2022.109140

Index Terms

Robust multi-view fuzzy clustering via softmin

Index terms have been assigned to the content through auto-classification.

Recommendations

Joint Robust Multi-view Spectral Clustering
Abstract
Current multi-view clustering algorithms use multistage strategies to conduct clustering, or require cluster number or similarity matrix prior, or suffer influence of irrelevant features and outliers. In this paper, we propose a Joint Robust Multi-...
Towards a robust fuzzy clustering
Data analysis

Fuzzy clustering helps to find natural vague boundaries in data. The Fuzzy C-Means method (FCM) is one of the most popular clustering methods based on minimization of a criterion function. However, one of the greatest disadvantages of this method is its ...
Fuzzy c-ordered-means clustering

Fuzzy clustering helps to find natural vague boundaries in data. The fuzzy c-means method is one of the most popular clustering methods based on minimization of a criterion function. However, one of the greatest disadvantages of this method is its ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Neurocomputing

Neurocomputing Volume 458, Issue C

Oct 2021

728 pages

ISSN:0925-2312

Issue’s Table of Contents

Elsevier B.V.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 11 October 2021

Author Tags

Qualifiers

Rapid-communication

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hu DDong ZLiang KYu HWang SLiu X(2024)High-order Topology for Deep Single-Cell Multiview Fuzzy ClusteringIEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2024.339974032:8(4448-4459)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TFUZZ.2024.3399740
P. Branco DT. de Carvalho F(2023)Medoid based semi-supervised fuzzy clustering algorithms for multi-view relational dataFuzzy Sets and Systems10.1016/j.fss.2023.108630469:COnline publication date: 15-Oct-2023
https://dl.acm.org/doi/10.1016/j.fss.2023.108630
Wei HChen LChen CDuan JHan RGuo L(2022)Fuzzy clustering for multiview data by combining latent informationApplied Soft Computing10.1016/j.asoc.2022.109140126:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.asoc.2022.109140

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents