Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3205455.3205587acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Comparison of parallel surrogate-assisted optimization approaches

Published: 02 July 2018 Publication History

Abstract

The availability of several CPU cores on current computers enables parallelization and increases the computational power significantly. Optimization algorithms have to be adapted to exploit these highly parallelized systems and evaluate multiple candidate solutions in each iteration. This issue is especially challenging for expensive optimization problems, where surrogate models are employed to reduce the load of objective function evaluations.
This paper compares different approaches for surrogate model-based optimization in parallel environments. Additionally an easy to use method, which was developed for an industrial project, is proposed. All described algorithms are tested with a variety of standard benchmark functions. Furthermore, they are applied to a real-world engineering problem, the electrostatic precipitator problem. Expensive computational fluid dynamics simulations are required to estimate the performance of the precipitator. The task is to optimize a gas-distribution system so that a desired velocity distribution is achieved for the gas flow throughout the precipitator. The vast amount of possible configurations leads to a complex discrete valued optimization problem. The experiments indicate that a hybrid approach works best, which proposes candidate solutions based on different surrogate model-based infill criteria and evolutionary operators.

References

[1]
Thomas Bartz-Beielstein and Martin Zaefferer. 2017. Model-based methods for continuous and discrete global optimization. Applied Soft Computing 55 (2017). 154 -- 167.
[2]
Bernd Bischl, Simon Wessing, Nadja Bauer, Klaus Friedrichs, and Claus Weihs. 2014. MOI-MBO: Multiobjective Infill for Parallel Model-Based Optimization. In Learning and Intelligent Optimization, Panos M. Pardalos, Mauricio G.C. Resende, Chrysafis Vogiatzis, and Jose L. Walteros (Eds.). Springer International Publishing, Cham, 173--186.
[3]
William Jay Conover. 1999. Practical Nonparametric Statistics, 3rd Edition. Wiley.
[4]
William Jay Conover and Ronald L. Iman. 1979. On multiple-comparisons procedures. Technical Report Tech. Rep. LA-7677-MS. Los Alamos Sci. Lab.
[5]
Alexander Forrester, Andy Keane, et al. 2008. Engineering design via surrogate modelling: a practical guide. John Wiley & Sons.
[6]
David Ginsbourger, Rudolphe Le Riche, and Laurent Carraro. 2010. Kriging is well-suited to parallelize optimization. In Computational Intelligence in Expensive Optimization Problems. Springer, 131--162.
[7]
Raphael T. Haftka, Diane Villanueva, and Anirban Chaudhuri. 2016. Parallel surrogate-assisted global optimization with expensive functions - a survey. Structural and Multidisciplinary Optimization 54, 1 (01 Jul 2016), 3--13.
[8]
Donald R. Jones, Matthias Schonlau, and William J. Welch. 1998. Efficient Global Optimization of Expensive Black-Box Functions. Journal of Global Optimization 13, 4 (01 Dec 1998), 455--492.
[9]
William H. Kruskal and W. Allen Wallis. 1952. Use of Ranks in One-Criterion Variance Analysis. J. Amer. Statist. Assoc. 47, 260 (1952), 583--621.
[10]
Alison L. Marsden, Meng Wang, John E. Dennis, and Parviz Moin. 2004. Optimal Aeroacoustic Shape Design Using the Surrogate Management Framework. Optimization and Engineering 5, 2 (01 Jun 2004), 235--262.
[11]
Jonas Mockus, Vytautas Tiesis, and Antanas Zilinskas. 1978. Towards Global Optimization 2. North-Holland, Chapter The application of Bayesian methods for seeking the extremum, 117--129.
[12]
Thorsten Pohlert. 2014. The Pairwise Multiple Comparison of Mean Ranks Package (PMCMR). (2014). http://CRAN.R-project.org/package=PMCMR R package.
[13]
N. V. Queipo, R. T. Haftka, W. Shyy, T. Goel, R. Vaidyanathan, and P. K. Tucker. 2005. Surrogate-based analysis and optimization. Progress in aerospace sciences (2005).
[14]
Jakob Richter, Helena Kotthaus, Bernd Bischl, Peter Marwedel, Jörg Rahnenführer, and Michel Lang. 2016. Faster Model-Based Optimization Through Resource-Aware Scheduling Strategies. In Learning and Intelligent Optimization, Paola Festa, Meinolf Sellmann, and Joaquin Vanschoren (Eds.). Springer International Publishing, Cham, 267--273.
[15]
Matthias Schonlau. 1997. Computer experiments and global optimization. (1997).
[16]
Matthew A. Taddy, Herbert K. H. Lee, Genetha A. Gray, and Joshua D. Griffin. 2009. Bayesian Guided Pattern Search for Robust Local Optimization. Technometrics 51, 4 (2009), 389--401.
[17]
Rasmus K. Ursem. 2014. From Expected Improvement to Investment Portfolio Improvement: Spreading the Risk in Kriging-Based Optimization. Springer International Publishing, Cham, 362--372.
[18]
Henry G Weller, G Tabor, Hrvoje Jasak, and C Fureby. 1998. A tensorial approach to computational continuum mechanics using object-oriented techniques. Computers in physics 12, 6 (1998), 620--631.
[19]
Martin Zaefferer, Joerg Stork, Martina Friese, Andreas Fischbach, Boris Naujoks, and Thomas Bartz-Beielstein. 2014. Efficient Global Optimization for Combinatorial Problems. In Proceedings of the 2014 Conference on Genetic and Evolutionary Computation (GECCO'14). ACM, New York, NY, USA, 871--878.

Cited By

View all
  • (2024)Surrogate Models and Ensemble Strategies for Expensive Evolutionary Optimization: An Industrial Case StudyIEEE Access10.1109/ACCESS.2024.341681112(86144-86159)Online publication date: 2024
  • (2024)Performance Comparison of Surrogate-Assisted Evolutionary Algorithms on Computational Fluid Dynamics ProblemsParallel Problem Solving from Nature – PPSN XVIII10.1007/978-3-031-70068-2_19(303-321)Online publication date: 7-Sep-2024
  • (2023)Surrogate-assisted evolutionary optimisation: a novel blueprint and a state of the art surveyEvolutionary Intelligence10.1007/s12065-023-00882-817:4(2213-2243)Online publication date: 3-Oct-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '18: Proceedings of the Genetic and Evolutionary Computation Conference
July 2018
1578 pages
ISBN:9781450356183
DOI:10.1145/3205455
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 July 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. electrostatic precipitator
  2. modeling
  3. optimization
  4. parallelization
  5. surrogates

Qualifiers

  • Research-article

Conference

GECCO '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)5
Reflects downloads up to 26 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Surrogate Models and Ensemble Strategies for Expensive Evolutionary Optimization: An Industrial Case StudyIEEE Access10.1109/ACCESS.2024.341681112(86144-86159)Online publication date: 2024
  • (2024)Performance Comparison of Surrogate-Assisted Evolutionary Algorithms on Computational Fluid Dynamics ProblemsParallel Problem Solving from Nature – PPSN XVIII10.1007/978-3-031-70068-2_19(303-321)Online publication date: 7-Sep-2024
  • (2023)Surrogate-assisted evolutionary optimisation: a novel blueprint and a state of the art surveyEvolutionary Intelligence10.1007/s12065-023-00882-817:4(2213-2243)Online publication date: 3-Oct-2023
  • (2023)Final EvaluationEnhancing Surrogate-Based Optimization Through Parallelization10.1007/978-3-031-30609-9_5(109-114)Online publication date: 30-May-2023
  • (2023)ApplicationEnhancing Surrogate-Based Optimization Through Parallelization10.1007/978-3-031-30609-9_4(95-107)Online publication date: 30-May-2023
  • (2023)Methods/ContributionsEnhancing Surrogate-Based Optimization Through Parallelization10.1007/978-3-031-30609-9_3(29-94)Online publication date: 30-May-2023
  • (2023)IntroductionEnhancing Surrogate-Based Optimization Through Parallelization10.1007/978-3-031-30609-9_1(1-7)Online publication date: 30-May-2023
  • (2022)Benchmarking an algorithm for expensive high-dimensional objectives on the bbob and bbob-largescale testbedsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3534006(1725-1733)Online publication date: 9-Jul-2022
  • (2022)Benchmark-Driven Configuration of a Parallel Model-Based Optimization AlgorithmIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.316384326:6(1365-1379)Online publication date: Dec-2022
  • (2022)HAS-EA: a fast parallel surrogate-assisted evolutionary algorithmMemetic Computing10.1007/s12293-022-00376-715:1(103-115)Online publication date: 11-Oct-2022
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media