Abstract
The selection of the mutation strategy for differential evolution (DE) algorithm plays an important role in the optimization performance, such as exploration ability, convergence accuracy and convergence speed. To improve these performances, an improved differential evolution algorithm with neighborhood mutation operators and opposition-based learning, namely NBOLDE, is developed in this paper. In the proposed NBOLDE, the new evaluation parameters and weight factors are introduced into the neighborhood model to propose a new neighborhood strategy. On this basis, a new neighborhood mutation strategy based on DE/current-to-best/1, namely DE/neighbor-to-neighbor/1, is designed in order to replace large-scale global mutation by local neighborhood mutation with high search efficiency. Then, a generalized opposition-based learning is employed to optimize the initial population and select the better solution between the current solution and reverse solution in order to approximate global optimal solution, which can amend the convergence direction, accelerate convergence, improve efficiency, enhance the stability and avoid premature convergence. Finally, the proposed NBOLDE is compared with four state-of-the-art DE variants by 12 benchmark functions with low-dimension and high-dimension. The experiment results indicate that the proposed NBOLDE has a faster convergence speed, higher convergence accuracy, and better optimization capabilities in solving high-dimensional complex functions.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Chakraborty J, Konar A, Chakraborty U, Jain L (2008) Distributed cooperative multi-robot path planning using differential evolution. IEEE Congr Evol Comput CEC 2008:718–725
Chakraborty J, Konar A, Jain LC et al (2009) Cooperative multi-robot path planning using differential evolution. J Intell Fuzzy Syst 20(1–2):13–27
Chattopadhyay S, Sanyal SK, Chandra A (2010) Design of FIR filter using differential evolution optimization & to study its effect as a pulse-shaping filter in a QPSK modulate system. Int J Comput Sci Netw Secur 10(1):313–321
Chen R, Guo S, Wang XZ et al (2019) Fusion of multi-RSMOTE with fuzzy integral to classify bug reports with an imbalanced distribution. IEEE Trans Fuzzy Syst 27:2406–2420
Chen H, Heidari AA, Chen H et al (2020) Multi-population differential evolution-assisted Harris hawks optimization: framework and case studies. Future Gener Comput Syst 111:175–198
Das S, Abraham A, Chakraborty UK et al (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Congr Evolut Comput 13(3):526–553
Das S, Mullick SS, Suganthan PN (2016) Recent advances in differential evolution—an updated survey. Swarm Evol Comput 27:1–30
Deb S, Gao XZ, Tammi K, Kalita K, Mahanta P (2020) A new teaching–learning-based chicken swarm optimization algorithm. Soft Comput 24(7):5313–5331
Deng W, Xu JJ, Song YJ, Zhao HM (2020a) An effective improved co-evolution ant colony optimisation algorithm with multi-strategies and its application. Int J Bioinsp Comput 16(3):158–170
Deng W, Xu JJ, Zhao HM, Song YJ (2020b) A novel gate resource allocation method using improved PSO-based QEA. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2020.3025796
Deng W, Xu JJ, Song YJ, Zhao HM (2020c) Differential evolution algorithm with wavelet basis function and optimal mutation strategy for complex optimization problem. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2020.106724
Deng W, Liu HL, Xu JJ, Zhao HM, Song YJ (2020d) An improved quantum-inspired differential evolution algorithm for deep belief network. IEEE Trans Instrum Meas 69(10):7319–7327
Deng W, Xu JJ, Gao XZ, Zhao HM (2020e) An enhanced MSIQDE algorithm with novel multiple strategies for global optimization problems. IEEE Trans Syst Man Cybern Syst. https://doi.org/10.1109/tsmc.2020.3030792
Dong WY, Kang LL, Zhang WS (2017) Opposition-based particle swarm optimization with adaptive mutation strategy. Soft Comput 21(17):5081–5090
Gao XZ, Nalluri MSR, Kannan K, Sinharoy D (2020) Multi-objective optimization of feature selection using hybrid cat swarm optimization. Sci China Technol Sci. https://doi.org/10.1007/s11431-019-1607-7
Heidari AA, Mirjalili S, Faris H et al (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872
Hu HL, Wang L, Peng L, Zeng YR (2020) Effective energy consumption forecasting using enhanced bagged echo state network. Energy 193:116778
Ilonen J, Kamarainen JK, Lampinen J (2003) Differential evolution training algorithm for feed-forward neural networks. Neural Process Lett 17(1):93–105
Karaboga N (2005) Digital IIR filter design using differential evolution algorithm. EURASIP J Adv Signal Process 2005(8):1–8
Leon M, Xiong N (2014) Investigation of mutation strategies in differential evolution for solving global optimization problems. In: International conference on artificial intelligence and soft computing, ICAISC 2014: artificial intelligence and soft computing, pp 372–383
Li TY, Shi JY, Li XS et al (2019) Image encryption based on pixel-level diffusion with dynamic filtering and DNA-level permutation with 3D Latin cubes. Entropy 21(3):319
Li S, Chen H, Wang M et al (2020) Slime mould algorithm: a new method for stochastic optimization. Future Gener Comput Syst 111:300–323
Liu Y, Wang XX, Zhai ZG et al (2019) Timely daily activity recognition from headmost sensor events. ISA Trans 94:379–390
Liu B, Chen T, Jia P, Wang L (2020a) Effective public service delivery supported by time-decayed Bayesian personalized ranking. Knowl Based Syst 206:106376
Liu Y, Mu Y, Chen K, Li Y, Guo J (2020b) Daily activity feature selection in smart homes based on pearson correlation coefficient. Neural Process Lett 51(2):1771–1787
Mallipeddi R, Suganthan PN, Pan QK et al (2010) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696
Pavlenko T (2003) On feature selection, curse-of-dimensionality and error probability in discriminant analysis. J Statal Plan Inference 115(2):565–584
Peng L, Zhu Q, Lv SX, Wang L (2020) Effective long short-term memory with fruit fly optimization algorithm for time series forecasting. Soft Comput. https://doi.org/10.1007/s00500-020-04855-2
Pestovss V (2000) On the geometry of similarity search: dimensionality curse and concentration of measure. Inf Process Lett 73(1):47–51
Piotrowski AP (2013) Adaptive memetic differential evolution with global and local neighborhood-based mutation operators. Inf Sci 241(12):164–194
Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417
Rahnamayan S, Tizhoosh H, Salama M (2008) Opposition-based differential evolution. IEEE Trans Evolut Comput 12(1):64–79
Ren ZR, Skjetne R, Verma AS, Jiang ZY, Gao Z, Halse KH (2021) Active heave compensation of floating wind turbine installation using a catamaran construction vessel. Mar Struct 75:102868
Song YJ, Wu DQ, Deng W, Gao XZ, Li TY, Zhang B, Li YG (2020) MPPCEDE: multi-population parallel co-evolutionary differential evolution for parameter optimization. Energy Convers Manag. https://doi.org/10.1016/j.enconman.2020.113562
Storn R, Price K (1995) Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical Report TR-95-012, ICSI
Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. IEEE Congr Evolut Comput CEC 2013(2013):71–78
Tizhoosh HR (2005) Opposition-based learning: a new scheme for machine intelligence. In: Proceedings of the 2005 international conference on computational intelligence for modelling, control and automation, and international conference on intelligent agents, web technologies and internet commerce (CIMCA-IAWTIC’05), vol 1, pp 695–701
Tizhoosh HR (2006) Opposition-based reinforcement learning. J Adv Comput Intell Intell Inform 10(4):578–585
Ventresca M, Tizhoosh HR (2006) Improving the convergence of backpropagation by opposite transfer functions. In: The 2006 IEEE international joint conference on neural network proceedings, Vancouver, BC, pp 4777–4784
Wang X, Gao XZ, Ovaska SJ (2005) A hybrid optimization algorithm in power filter design. In Proceedings of the 31st annual conference of the IEEE industrial electronics society, Raleigh, NC, pp 1335–1340
Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE IEEE Trans Evol Comput 15(1):55–66
Wang L, Xiong Y, Li S et al (2019a) New fruit fly osptimization algorithm with joint search strategies for function optimization problems. Knowl Based Syst 176:77–96
Wang L, Hu HL, Liu R, Zhou XJ (2019b) An improved differential harmony search algorithm for function optimization problems. Soft Comput 23(13):4827–4852
Wang L, Peng L, Wang SR et al (2020) Advanced backtracking search optimization algorithm for a new joint replenishment problem under trade credit with grouping constraint. Appl Soft Comput 86:105953
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Congr Evolut Comput 1(1):67–82
Xu YT, Chen HL, Luo J et al (2019) Enhanced Moth-flame optimizer with mutation strategy for global optimization. Inf Sci 492:181–203
Xue Y, Xue B, Zhang MJ (2019) Self-adaptive particle swarm optimization for large-scale feature selection in classification. ACM Trans Knowl Discov D 13(5):50
Zhang YY, Jin ZG (2020) Quantum-behaved particle swarm optimization with generalized space transformation search. Soft Comput 24(19):14981–14997
Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Congr Evolut Comput 13(5):945–958
Zhang WJ, Xie XF (2003) DEPSO: hybrid particle swarm with differential evolution operator. Proc IEEE Int Conf Syst Man Cybern 4:3816–3821
Zhao H, Zheng J, Deng W, Song Y (2020) Semi-supervised broad learning system based on manifold regularization and broad network. IEEE Trans Circ Syst I Reg Pap 67(3):983–994
Acknowledgements
The authors would like to thank all the reviewers for their constructive comments. This work was supported by the National Natural Science Foundation of China (61771087), the Research and Innovation Funding Project for Postgraduates of Civil Aviation University of China (2020YJS026) and the Research Foundation for Civil Aviation University of China (2020KYQD123). The program for the initialization, study, training and simulation of the proposed algorithm in this article was written with the tool-box of MATLAB 2018b produced by the Math-Works, Inc.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interests.
Human participants and/or animals
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Deng, W., Shang, S., Cai, X. et al. An improved differential evolution algorithm and its application in optimization problem. Soft Comput 25, 5277–5298 (2021). https://doi.org/10.1007/s00500-020-05527-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-020-05527-x