Abstract
Aiming at existing symmetric regularized picture fuzzy clustering with weak robustness, and it is difficult to meet the need for image segmentation in the presence of high noise. Hence, a robust dynamic semi-supervised symmetric regularized picture fuzzy clustering with KL-divergence and spatial information constraints is presented in this paper. Firstly, a weighted squared Euclidean distance from current pixel value, its neighborhood mean and median to clustering center is firstly proposed, and it is embedded into the objective function of symmetric regularized picture fuzzy clustering to obtain spatial picture fuzzy clustering. Secondly, the idea of maximum entropy fuzzy clustering is introduced into picture fuzzy clustering, and an entropy-based picture fuzzy clustering with clear physical meaning is constructed to avoid the problem of selecting weighted factors. Subsequently, the prior information of the current pixel is obtained by means of weighted local membership of neighborhood pixels, and it is embedded into the objective function of maximum entropy picture fuzzy clustering with multiple complementary spatial information constraints through KL-divergence, a robust dynamic semi-supervised picture fuzzy clustering optimization model and its iterative algorithm are given. In the end, this proposed algorithm is strictly proved to be convergent by Zangwill theorem. The experiments on various images and standard datasets illustrate how our proposed algorithm works. This proposed algorithm has excellent segmentation performance and anti-noise robustness, and outperforms eight state-of-the-art fuzzy or picture fuzzy clustering-related algorithms in the presence of high noise.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Xu G, Zhou J, Dong J, Chen C, Chen Y (2020) Multivariate morphological reconstruction based fuzzy clustering with a weighting multi-channel guided image filter for color image segmentation. Int J Mach Learn Cybern 11(3):2793–2806. https://doi.org/10.1007/s13042-020-01151-1
Yang X, Zhou YP, Zhou D, Hu YJ (2016) Image segmentation and proto-objects detection based visual tracking. Optik 131:1085–1094. https://doi.org/10.1016/j.ijleo.2016.11.197
Carata SV, Neagoe VE (2016) A pulse-coupled neural network approach for image segmentation and its pattern recognition application. In: 2016 International Conference on Communications (COMM), IEEE. https://doi.org/10.1109/ICComm.2016.7528317
Luo J, Wang Y, Wang QH, Zhai RF, Zong YH (2017) Automatic image segmentation of grape based on computer vision. Int Conf Intell Interact Syst Appl 541:365–370. https://doi.org/10.1007/978-3-319-49568-2_52
Cuevas E, Fausto F, Adrián G (2020) Locust search algorithm applied to multi-threshold segmentation. In: New advancements in swarm algorithms: operators and applications, vol 160. Intelligent Systems Reference Library, pp 211–240. https://doi.org/10.1007/978-3-030-16339-6_8
Pan HZ, Liu WQ, Li L, Zhou GL (2019) A novel level set approach for image segmentation with landmark constraints. Optik - Int J Light Electron Opt 182:257–268. https://doi.org/10.1016/j.ijleo.2019.01.009
Luo L, Liu S, Tong XY, Jiang PR, Yuan C, Zhao XH, Shang F (2019) Carotid artery segmentation using level set method with double adaptive threshold (DATLS) on TOF-MRA images. Magn Reson Imaging 63:123–130. https://doi.org/10.1016/j.mri.2019.08.002
Du M, Ding S, Xue Y (2017) A robust density peaks clustering algorithm using fuzzy neighborhood. Int J Mach Learn Cybern 9:1131–1140. https://doi.org/10.1007/s13042-017-0636-1
Ada N, Harsono T, Basuki A (2018) Cloud satellite image segmentation using Meng Hee Heng K-means and DBSCAN clustering. 2018 International electronics symposium on knowledge creation and intelligent computing (IES-KCIC), IEEE Press, pp 367–371. https://doi.org/10.1109/KCIC.2018.8628523
Goyal S, Kumar S, Zaveri MA, Shukla AK (2017) Fuzzy similarity measure based spectral clustering framework for noisy image segmentation. Int J Uncertain Fuzziness and Knowl-Based Syst 25(4):649–673. https://doi.org/10.1142/S0218488517500283
Gou SP, Db Li, Hai D, Chen WS, Du FF, Jiao LC (2018) Spectral clustering with eigenvalue similarity metric method for POL-SAR image segmentation of land cover. J Geogr Inf Syst 10:150–164. https://doi.org/10.4236/jgis.2018.101007
Ludwig SA (2015) MapReduce-based fuzzy c-means clustering algorithm: implementation and scalability. Int J Mach Learn Cybern 6(6):923–934. https://doi.org/10.1007/s13042-015-0367-0
Li QH, Ural S, Anderson J, Shan J (2016) A fuzzy mean-shift approach to Lidar waveform decomposition. IEEE Trans Geosci Remote Sens 54(12):7112–7121. https://doi.org/10.1109/TGRS.2016.2596105
Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Adv Appl Pattern Recogn. https://doi.org/10.1007/978-1-4757-0450-1
Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2–3):191–203. https://doi.org/10.1016/0098-3004(84)90020-7
Bezdek JC, Hathaway RJ, Sabin MJ, Tucker W (1987) Convergence theory for fuzzy c-means: counterexamples and repairs. IEEE Trans Syst Man Cybern 17(5):873–877. https://doi.org/10.1109/TSMC.1987.6499296
Chen SC, Zhang DQ (2004) Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure. IEEE Trans Syst Man Cybern Part B (Cybern) 34(4):1907–1916. https://doi.org/10.1109/TSMCB.2004.831165
Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJ (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Med Imaging Graph 30(1):9–15. https://doi.org/10.1016/j.compmedimag.2005.10.001
Caldairou B, Passat N, Habas PA, Studholme C, Rousseau F (2011) A non-local fuzzy segmentation method: application to brain MRI. Pattern Recogn 44(9):1916–1927. https://doi.org/10.1016/j.patcog.2010.06.006
Zhang DQ, Chen SC (2004) A novel kernelized fuzzy C-means algorithm with application in medical image segmentation. Artif Intell Med 32:37–50. https://doi.org/10.1016/j.artmed.2004.01.012
Ichihashi H, Miyagishi K, Honda K (2001) Fuzzy c-means clustering with regularization by K-L Information. IEEE Int Conf Fuzzy Syst 2:924–927. https://doi.org/10.1109/FUZZ.2001.1009107
Chatzis SP, Varvarigou TA (2008) A fuzzy clustering approach toward hidden Markov random field models for enhanced spatially constrained image segmentation. IEEE Trans Fuzzy Syst 16(5):1351–1361. https://doi.org/10.1109/TFUZZ.2008.2005008
Gong MG, Su L, Jia M (2014) Fuzzy clustering with a modified MRF energy function for change detection in synthetic aperture radar image. IEEE Trans Fuzzy Syst 22(1):98–109. https://doi.org/10.1109/TFUZZ.2013.2249072
Zhang H, Wu QM, Zheng Y (2014) Effective fuzzy clustering algorithm with Bayesian model and mean template for image segmentation. IET Image Proc 8(10):571–581. https://doi.org/10.1049/iet-ipr.2013.0178
Gharieb RR, Gendy G (2015) Fuzzy c-means with local membership based weighted pixel distance and KL divergence for image segmentation. J Pattern Recogn Res 10(1):53–60. https://doi.org/10.13176/11.605
Son LH, Tuan TM (2016) A cooperative semi-supervised fuzzy clustering framework for dental X-ray image segmentation. Expert Syst Appl 46:380–393. https://doi.org/10.1016/j.eswa.2015.11.001
Son LH, Tuan TM (2017) Dental segmentation from X-ray images using semi-supervised fuzzy clustering with spatial constraints. Eng Appl Artif Intell 59:186–195. https://doi.org/10.1016/j.engappai.2017.01.003
Yang Y, Wu CM, Li YW, Zhang SW (2020) Robust semisupervised kernelized fuzzy local information C-means clustering for image segmentation. Math Probl Eng 2020(3):1–22. https://doi.org/10.1155/2020/5648206
Chaira T (2011) A novel intuitionistic fuzzy c-means clustering algorithm and its application to medical images. Appl Soft Comput 11(2):1711–1717. https://doi.org/10.1016/j.asoc.2010.05.005
Son LH (2015) DPFCM: a novel distributed picture fuzzy clustering method on picture fuzzy sets. Expert Syst Appl 42(1):51–66. https://doi.org/10.1016/j.eswa.2014.07.026
Thong PH, Son LH (2016) Picture fuzzy clustering: a new computational intelligence method. Soft Comput 20(9):3549–3562. https://doi.org/10.1007/s00500-015-1712-7
Sun JM, Wu CM (2019) Regularized picture fuzzy clustering and robust segmentation algorithm. Comput Eng Appl 55(11):179–186. https://doi.org/10.3778/j.issn.1002-8331.1803-0110
Wu CM, Sun JM (2019) Adaptive robust picture fuzzy clustering algorithm based on total divergence. Acta Armamentarii 40(9):1890–1901. https://doi.org/10.3969/j.issn.1000-1093.2019.09.014
Fu HJ, Wu XH, Mao HP, Wu B (2011) Fuzzy entropy clustering using possibilistic approach. Proc Eng 15:1993–1997. https://doi.org/10.1016/j.proeng.2011.08.372
Yin XS, Shu T, Huang Q (2012) Semi-supervised fuzzy clustering with metric learning and entropy regularization. Knowl-Based Syst 35:304–311. https://doi.org/10.1016/j.knosys.2012.05.016
Li QY, Ma YC, Smarandache F, Zhu SW (2018) Single-valued neutrosophic clustering algorithm based on tsallis entropy maximization. Axioms 7(3):57. https://doi.org/10.3390/axioms7030057
Gharieb RR, Gendy G (2014) Fuzzy C-means with a local membership KL distance for medical image segmentation. In: IEEE Proc., Cairo Int Biomed. Eng. Conf. (CIBEC), Egypt, Giza, pp 47–50. https://doi.org/10.1109/CIBEC.2014.7020912
Pedrycz W, Waletzky J (1997) Fuzzy clustering with partial supervision. IEEE Trans Syst Man Cybern B Cybern 27(5):787–795. https://doi.org/10.1109/3477.623232
Sahbi H, Boujemma N (2005) Fuzzy clustering: consistency of entropy regularization. In: Reusch B (ed) Computational intelligence, theory and applications, advances in soft computing, vol 33. Springer, pp 95–107. https://doi.org/10.1007/3-540-31182-3_9
Wu CM, Kang ZQ (2021) Robust entropy-based symmetric regularized picture fuzzy clustering for image segmentation. Digit Signal Process 110:102905. https://doi.org/10.1016/j.dsp.2020.102905
Salehi F, Keyvanpour MR, Sharifi A (2021) SMKFC-ER: semi-supervised multiple kernel fuzzy clustering based on entropy and relative entropy. Inf Sci 547:667–688. https://doi.org/10.1016/j.ins.2020.08.094
Zhao F, Liu HQ, Fan JL (2015) Multi-objective evolutionary clustering image segmentation based on complementary spatial information. J Electron Inf Technol 37(3):672–678. https://doi.org/10.11999/JEIT140371
Zhao QH, Jia SH, Gao J, Gao X (2019) Fuzzy clustering image segmentation combined with membership space constraints. Sci Surv Mapp 44(5):164–170. https://doi.org/10.16251/j.cnki.1009-2307.2019.05.025
Saha A, Das S (2019) Stronger convergence results for the center-based fuzzy clustering with convex divergence measure. IEEE Trans Cybern 49(12):4229–4242. https://doi.org/10.1109/TCYB.2018.2861211
Giordana N, Pieczynski W (1997) Estimation of generalized multisensor hidden Markov chains and unsupervised image segmentation. IEEE Trans Pattern Anal Mach Intell 19(5):465–475. https://doi.org/10.1109/34.589206
Guo YH, Sengur A (2013) A novel color image segmentation approach based on neutrosophic set and modified fuzzy c-Means. Circuits Syst Signal Process 32(4):1699–1723. https://doi.org/10.1007/s00034-012-9531-x
Gharieb RR, Gendy G, Selim H (2018) A hard c-means clustering algorithm incorporating membership KL divergence and local data information for noisy image segmentation. Int J Pattern Recognit Artif Intell 32(4):758–769. https://doi.org/10.1016/j.asoc.2017.05.055
Kumar D, Verma H, Mehra A (2019) A modified intuitionistic fuzzy c-means clustering approach to segment human brain MRI image. Multimed Tools Appl 78(10):12663–12687. https://doi.org/10.1007/s11042-018-5954-0
Thong PH, Son LH (2016) A novel automatic picture fuzzy clustering method based on particle swarm optimization and picture composite cardinality. Knowl Based Syst 109:48–60. https://doi.org/10.1016/j.knosys.2016.06.023
Maulik U, Bandyopadhyay S (2002) Performance evaluation of some clustering algorithms and validity indices. IEEE Trans Pattern Anal Mach Intell 24(12):1650–1654. https://doi.org/10.1109/TPAMI.2002.1114856
Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings eighth IEEE international conference on computer vision, vol 2, pp 416–423. https://doi.org/10.1109/ICCV.2001.937655
Gan HT, Fan YL, Luo ZZ, Zhang QZ (2017) Local homogeneous consistent safe semi-supervised clustering. Expert Syst Appl 97:384–393. https://doi.org/10.1016/j.eswa.2017.12.046
Gan HT (2019) Safe semi-supervised fuzzy c-means clustering. IEEE Access 9:181976–181987. https://doi.org/10.1109/ACCESS.2019.2929307
Baselice F, Coppolino L, D'Antonio S, Ferraioli G, Sgaglione L (2015) A DBSCAN based approach for jointly segment and classify brain MR images. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC), IEEE Press. Pp 2993–2996. https://doi.org/10.1109/EMBC.2015.7319021
Zhang Y, Bai X, Fan R, Wang Z (2019) Deviation-sparse fuzzy c-means with neighbor information constraint. IEEE Trans Fuzzy Syst 27(1):185–199. https://doi.org/10.1109/TFUZZ.2018.2883033
Lei T, Jia X, Zhang Y et al (2018) Significantly fast and robust fuzzy c-means clustering algorithm based on morphological reconstruction and membership filtering. IEEE Trans Fuzzy Syst 26(5):3027–3041. https://doi.org/10.1109/TFUZZ.2018.2796074
Zhang XF, Sun YJ, Liu H, Hou ZJ, Zhao F, Zhang CM (2021) Improved clustering algorithms for image segmentation based on non-local information and back projection. Inf Sci 550:129–144. https://doi.org/10.1016/j.ins.2020.10.039
Zhao F, Fan JL, Liu HQ (2014) Optimal-selection-based suppressed fuzzy c-means clustering algorithm with self-tuning non local spatial information for image segmentation. Expert Syst Appl 41(9):4083–4093. https://doi.org/10.1016/j.eswa.2014.01.003
László S, László L, David I (2020) A review on suppressed fuzzy c-means clustering models. Acta Universitatis Sapientiae, Informatica 12(2):302–324. https://doi.org/10.2478/ausi-2020-0018
Acknowledgements
This work was supported by the National Natural Science Foundation of China (61671377, 51709228) and the Shaanxi Natural Science Foundation of China (2016JM8034, 2017JM6107). The authors would like to thank the anonymous reviewers for their constructive suggestions to improve the overall quality of the paper. Besides, the authors would like to thank the School of Electronic Engineering, Xi’an University of Posts & Telecommunications, Xi’an, China, for financial support.
Author information
Authors and Affiliations
Contributions
CW: conceptualization, data curation, funding acquisition, methodology, project administration, resources, supervision, validation, visualization. JZ: formal analysis, investigation, software, writing—original draft, writing—review and editing.
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A
Appendix A
Proof: The specific derivation process of Eqs. (19)–(22) of the proposed algorithm is as follows. The optimization model of robust semi-supervised spatial picture fuzzy clustering with local membership and KL-divergence is given as follows.
s.t.
The objective function of minimization of the optimization model Eq. (45) obtained by Lagrange multiplier method, we construct an unconstrained optimization objective function as:
where \(d_{ij}^{2} = w_{1} ||x_{i} - v_{j} ||^{2} + w_{2} ||\overline{x}_{i} - v_{j} ||^{2} + w_{3} ||\hat{x}_{i} - v_{j} ||^{2}\), \(\alpha_{i}\), \(\beta_{i}\) and \(\gamma\) are Lagrange multipliers. Taking the partial derivative of Eq. (49) and set the partial derivative of \(v_{j}\), \(u_{ij}\), \(\eta_{ij}\) and \(\xi_{ij}\) to zero, then
We simplify Eq. (50) and obtain
Further, obtain
We simplify Eq. (53) and obtain
Further, obtain
By substituting Eq. (55) into Eq. (47), we obtain:
Combining Eq. (55) and Eq. (56), we can calculate \(u_{ij}\) as follows.
So that
Combining Eq. (53) with Eq. (59), we obtain:
Combining Eq. (53) with Eq. (61), we obtain:
We combine Eq. (62) with Eq. (60) and obtain the following equation.
According to Eq. (63), we obtain the expression of \(\eta_{ij}\)
Lastly, by using famous Yager’s fuzzy complement operator \(N_{\alpha } {(}x){ = }(1 - x^{\alpha } )^{{{1 \mathord{\left/ {\vphantom {1 \alpha }} \right. \kern-\nulldelimiterspace} \alpha }}}\), We can obtain the expression of refusal degree \(\xi_{ij}\) as follows.
Rights and permissions
About this article
Cite this article
Wu, C., Zhang, J. Robust semi-supervised spatial picture fuzzy clustering with local membership and KL-divergence for image segmentation. Int. J. Mach. Learn. & Cyber. 13, 963–987 (2022). https://doi.org/10.1007/s13042-021-01429-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-021-01429-y