Abstract
Nearest neighbor partitioning (NNP) method has been proved to be an effective method to enhance the quality of neural network classifiers. However, there are many cluster shapes in NNP, which results in a large number of local optimal solutions in the searching space by the traditional particle swarm optimization (PSO) algorithm. Therefore, the multi-layer particle swarm optimization (MLPSO) is introduced to increase the diversity of searching groups through increasing the number of layers, thereby improving the performance when facing with large scale problems. In this study, we adopt the combination of multi-layer particle swarm optimization and nearest neighbor partitioning to solve the local optimal problem caused by multi-cluster shapes in the optimization of NNP. Experimental results show that this method improves the performance of classifier.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Heckerman, D., Wellman, M.P.: Bayesian networks. Commun. ACM 38(3), 27–31 (1995)
Wang, L., Yang, B., Wang, S., Liang, Z.: Building image feature kinetics for cement hydration using gene expression programming with similarity weight tournament selection. IEEE Trans. Evol. Comput. 19(5), 679–693 (2015)
Yeh, I.C.: Modeling of strength of high-performance concrete using artificial neural networks. Cem. Concr. Res. 28(12), 1797–1808 (1998)
Misra, B.B., Dehuri, S., Dash, P.K., Panda, G.: A reduced and comprehensible polynomial neural network for classification. Pattern Recogn. Lett. 29(12), 1705–1712 (2008)
Wang, L., Orchard, J.: Investigating the evolution of a neuroplasticity network for learning. IEEE Trans. Syst. Man Cybern. Syst. PP(99), 1–13 (2017)
Chen, C.P., Liu, Z.: Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Trans. Neural Netw. Learn. Syst. 29(1), 10–24 (2018)
Gutierrez, P.A.: Neuro-logistic models based on evolutionary generalized radial basis function for the microarray gene expression classification problem. Neural Process. Lett. 34(2), 117–131 (2011)
Avci, E.: An expert target recognition system using a genetic wavelet neural network. Appl. Intell. 37(4), 475–487 (2012)
Yu, Q., Yan, R., Tang, H., Tan, K.C., Li, H.: A spiking neural network system for robust sequence recognition. NIEEE Trans. Neural Netw. Learn. Syst. 27(3), 621–635 (2016)
Wang, L., Yang, B., Chen, Y., Zhang, X., Orchard, J.: Improving neural-network classifiers using nearest neighbor partitioning. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2255–2267 (2017)
Wang, L., Yang, B., Orchard, J.: Particle swarm optimization using dynamic tournament topology. Appl. Soft Comput. 48, 584–596 (2016)
Wang, L., Yang, B., Chen, Y.: Improving particle swarm optimization using multi-layer searching strategy. Inf. Sci. 274(8), 70–94 (2014)
Bridle, J.S.: Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition. In: Neurocomputing, pp. 227–236. Springer, Berlin (1990)
Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2(1), 263–286 (1995)
Wang, L., Yang, B., Chen, Y., Abraham, A., Sun, H., Chen, Z., Wang, H.: Improvement of neural network classifier using floating centroids. Knowl. Inf. Syst. 31(3), 433–454 (2012)
Zhou, J., Chen, L., Chen, C.L.P., Zhang, Y., Li, H.X.: Fuzzy clustering with the entropy of attribute weights. Neurocomputing 198, 125–134 (2016)
Xiong, Z.Y., Liu, D.Q., Zhang, Y.F.: Constructing classifier of neural networks using improved genetic algorithms. Comput. Appl. 25(01), 31–34 (2005)
Zhou, W., Xiong, S.: Optimization of BP neural network classifier using genetic algorithm. Energy Procedia 11, 578–584 (2013)
Lin, C.T., Prasad, M., Saxena, A.: An improved polynomial neural network classifier using real-coded genetic algorithm. IEEE Trans. Syst. Man Cybern. Syst. 45(11), 1389–1401 (2015)
Booth, H.S., Maindonald, J.H., Wilson, S.R., Gready, J.E.: An efficient Z-score algorithm for assessing sequence alignments. J. Comput. Biol. A J. Comput. Mol. Cell Biol. 11(4), 616–625 (2004)
Yu, Z., Liu, Y., Yu, X., Pu, K.Q.: Scalable distributed processing of K nearest neighbor queries over moving objects. IEEE Trans. Knowl. Data Eng. 27(5), 1383–1396 (2015)
Acknowledgments
This work was supported by National Natural Science Foundation of China under Grant No. 61573166, No. 61572230, No. 61872419, No. 61873324, No. 81671785, No. 61672262. Science and technology project of Shandong Province under Grant No. 2015GGX101025. Project of Shandong Province Higher Educational Science and Technology Program under Grant no. J16LN07. Shandong Provincial Key R&D Program under Grant No. 2016ZDJS01A12, No. 2016GGX101001. Taishan Scholar Project of Shandong Province, China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhu, X. et al. (2020). Improving Nearest Neighbor Partitioning Neural Network Classifier Using Multi-layer Particle Swarm Optimization. In: Madureira, A., Abraham, A., Gandhi, N., Varela, M. (eds) Hybrid Intelligent Systems. HIS 2018. Advances in Intelligent Systems and Computing, vol 923. Springer, Cham. https://doi.org/10.1007/978-3-030-14347-3_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-14347-3_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-14346-6
Online ISBN: 978-3-030-14347-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)