Abstract
Designing efficient estimation of distribution algorithms for optimizing complex continuous problems is still a challenging task. This paper utilizes histogram probabilistic model to describe the distribution of population and to generate promising solutions. The advantage of histogram model, its intrinsic multimodality, makes it proper to describe the solution distribution of complex and multimodal continuous problems. To make histogram model more efficiently explore and exploit the search space, several strategies are brought into the algorithms: the surrounding effect reduces the population size in estimating the model with a certain number of the bins and the shrinking strategy guarantees the accuracy of optimal solutions. Furthermore, this paper shows that histogram-based EDA (Estimation of distribution algorithm) can give comparable or even much better performance than those predominant EDAs based on Gaussian models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Larrañaga P, Lozano J A. Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Kluwer Academic Publishers, 2002.
Pelikan M. Hierarchical Bayesian Optimization Algorithm: Toward A New Generation of Evolutionary Algorithms. Springer-Verlag, 2005.
Očenášek J. Parallel estimation of distribution algorithms [Dissertation]. Brno University of Technology, 2002.
Larrañaga P, Etxeberria R, Lozano J A, Peña J M. Optimization by learning and simulation of Bayesian and Gaussian networks. Technical Report EHU-KZAA-IK-4/99, University of the Basque Country, 1999.
Larrañaga P, Etxeberria R, Lozano J A, Peña J M. Optimization in continuous domains by learning and simulation of Gaussian networks. In Proc. the Genetic and Evolutionary Computation Conference, Las Vegas, Nevada, 2000, pp.201–204.
Sebag M, Ducolombier A. Extending Population-Based Incremental Learning to Continuous Search Spaces. Parallel Problem Solving from Nature– PPSN V, Springer-Verlag, 1998, pp.418–427.
Larrañaga P, Lozano J A, Bengoetxea E. Estimation of Distribution Algorithms based on multivariate normal and Gaussian networks. Technical report KZZA-IK-1-01, University of the Basque Country, 2001.
Bosman P, Thierens D. Expanding from Discrete to Continuous Estimation of Distribution Algorithms: IDEA. Parallel Problem Solving From Nature– PPSN VI, 2000, pp.767–776.
Ahn C W. Real-coded Bayesian optimization algorithm. In Proc. Advances in Evolutionary Algorithms: Theory, Design and Practice, 2006, pp.85–124.
Tsutsui S, Pelikan M, Goldberg D E. Evolutionary algorithm using marginal histogram models in continuous domain. In Proc. the 2001 Genetic and Evolutionary Computation Conference Workshop, San Francisco, CA, 2001, pp.230–233.
Petri K, Petri M. Information-theoretically optimal histogram density estimation. HIIT Technical Reports 2006–2, Helsinki Institute for Information Technology, 2006.
Pelikan M, David E G, Tsutsui S. Combining the strengths of the Bayesian optimization algorithm and adaptive evolution strategies. IlliGAL Report No. 2001023, 2001.
Yuan B, Gallagher M. Playing in continuous spaces: Some analysis and extension of population-based incremental learning. In Proc. IEEE Congress on Evolutionary Computation, 2003, pp.443–450.
Ding N, Zhou S, Sun Z. Optimizing continuous problems using estimation of distribution algorithms based on histogram model. In Proc. the 6th Conference of Simulated Evolution and Learning, Hefei, China, 2006, pp.545–552.
Bosman P, Thierens D. Continuous iterated density estimation evolutionary algorithms within the IDEA framework. In Proc. the Optimization by Building and Using Probabilistic Models OBUPM Workshop at GECCO-2000, San Francisco, California, 2000, pp.197–200.
Lu Q, Yao X. Clustering and learning Gaussian distribution for continuous optimization. IEEE Transactions on Systems, Man and Cybernetics-Part C, 2005, 35(2): 195–204.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is funded by the National Grand Fundamental Research 973 Program of China (Grant No. G2002cb312205).
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Ding, N., Zhou, SD. & Sun, ZQ. Histogram-Based Estimation of Distribution Algorithm: A Competent Method for Continuous Optimization. J. Comput. Sci. Technol. 23, 35–43 (2008). https://doi.org/10.1007/s11390-008-9108-0
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-008-9108-0