Abstract
This paper presents an adaptive, surrogate-based, engineering design methodology for the efficient use of numerical simulations of physical models. These surrogates are nonlinear regression models fitted with data obtained from deterministic numerical simulations using optimal sampling. A multistage Bayesian procedure is followed in the formulation of surrogates to support the evolutionary nature of engineering design. Information from computer simulations of different levels of accuracy and detail is integrated, updating surrogates sequentially to improve their accuracy. Data-adaptive optimal sampling is conducted by minimizing the sum of the eigenvalues of the prior covariance matrix. Metrics to quantify prediction errors are proposed and tested to evaluate surrogate accuracy given cost and time constraints. The proposed methodology is tested with a known analytical function to illustrate accuracy and cost tradeoffs. This methodology is then applied to the thermal design of embedded electronic packages with five design parameters. Temperature distributions of embedded electronic chip configurations are calculated using spectral element direct numerical simulations. Surrogates, built from 30 simulations in two stages, are used to predict responses of new design combinations and to minimize the maximum chip temperature.
Similar content being viewed by others
References
Nigen, J.S.; Amon, C.H. (1992) Concurrent thermal design: balancing accuracy with time constraints, IEEE Trans. on Computers, Hybrids and Manufacturing Technology, 15, 850–859
Kleijnen, J.P.C. (1992) Sensitivity analysis of simulation experiments: regression analysis and statistical design, Mathematics and Computers in Simulation, 34, 297–315
Bernardo, M.; Sacks, J.; Welch, W.; Liu, L.; Nazaret, W. (1992) Integrated circuit design optimization using a sequential strategy, IEEE Transactions CAD, 11, 361–372
Welch, W.; Buck, R.J.; Sacks, J.; Wynn, H.P.; Mitchell, T.J.; Morris, M.D. (1992) Screening, predicting and computer experiments, Technometrics, 34, 15–25
Director, S.W.; Feldmann, P.; Krishna, K. (1993) Statistical integrated circuit design, IEEE Journal of Solid-State Circuits, 28, 193–202
Osio, I.G. (1992) Optimization of shape rolling processes using finite element analysis and experimental design methodology, Master Thesis, Ohio University
Rizzo, A. (1994) Quality engineering with FEA and DOE, Mechanical Engineering, 116, 76–78
Yesilyurt, S.; Patera, A.T. (1995) Surrogates for numerical simulations; optimization of eddy-promoter heat exchangers, Computational Methods Applied to Mechanical Engineering, 121, 231–257
Yesilyurt, S.; Ghaddar, C.; Cruz, M.; Patera, A.T. (1996) Bayesian-validated surrogates for noisy computer simulations; application to random media, SIAM Journal of Scientific Computation (in press)
Queipo, N.; Devarakonda, R.; Humphrey, J.A.C. (1994) Genetic algorithms for thermosciences research: application to the optimized cooling of electronic components, International Journal of Heat and Mass Transfer, 37, 6, 893–908
Sacks, J.; Welch, W.; Mitchell, T.; Wynn, H.P. (1989b) Design and analysis of computer experiments (with discussion), Statistical Science, 4, 409–435
Currin, C.; Mitchell, T.; Morris, M.; Ylvisaker, D. (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments, Journal of the American Statistical Association, 86, 953–963
Morris, M.D.; Mitchell, T.J.; Ylvisaker, D. (1993) Bayesian design and analysis of computer experiments: use of derivatives in surface prediction, Technometrics, 35, 243–255
Park, J.-S. (1991) Tuning complex computer codes to data and optimal designs, PhD Thesis, University of Illinois, Department of Statistics
Park, J.-S. (1994) Optimal Latin-hypercube designs for computer experiments, Journal of Statistical Planning and Inference, 39, 95–111
Mitchell, T.J.; Morris, M.D. (1992) Bayesian design and analysis of computer experiments: two examples, Statistica Sinica, 2, 359–379
Welch, W.; Yu, T.-K.; Kang, S.M.; Sacks, J. (1990) Computer experiments for quality control by parameter design, Journal of Quality Technology, 22, 15–22
Cox, D.; Park, J.; Sacks, J.; Singer, C. (1991) Tuning complex computer code to data, Proceedings 23rd Interface Conference on Computer Science and Statistics, Interface Foundation, Fairfax Station, VA, 266–271
Bowman, K.P.; Sacks, J.; Chang, Y.F. (1993) Design and analysis of numerical experiments, Journal of Atmospheric Sciences, 50, 1267–1278
Shewry, M.C.; Wynn, H.P. (1987) Maximum entropy sampling, Journal of Applied Statistics, 14, 165–170
Lindley, D.V. (1956) On a measure of the information provided by an experiment, The Annals of Mathematical Statistics, 27, 986–1005
Johnson, M.E.; Moore, L.M.; Ylvisaker, D. (1990) Minimax and maximim distance designs, Journal of Statistical Planning and Inference, 26, 131–148
McKay, M.D.; Beckman, R.J.; Conover, W.J. (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 293–245
Mitchell, T.J. (1974) Computer construction of D-optimal first-order designs, Technometrics, 16, 211–220
Sacks, J.; Schiller, S.B.; Welch, W.J. (1989a) Designs for computer experiments, Technometrics, 31, 41–47
Osio, I.G. (1996) Multistage Bayesian surrogates and optimal sampling for engineering design and process optimization, PhD Thesis, Department of Mechanical Engineering, Carnegie Mellon University
Stein, M.L. (1989) Comment on Design and analysis of computer experiments by Sacks et al., Statistical Science, 4, 409–435
Matérn, B. (1986) Spatial Variation (2nd Ed.), Springer-Verlag, Berlin
Box, G.E.P.; Tiao, G.C. (1992) Bayesian Inference in Statistical Analysis, John Wiley, New York
Morris, M.D. (1994) Personal communications
Brooke, A.; Kendrick, D.; Meeraus, A. (1992) GAMS: A User's Guide, Release 2.25, The Scientific Press, San Francisco
Drud, A. (1992) GAMS/CONOPT, Appendix to the GAMS User's Guide, ARKI Consulting and Development, DK-2880 Bagsvaerd, Denmark
Fiacco, A.V.; Liu, J. (1994) Survey of current applications of nonlinear programming, Department of Operations Research, The George Washington University, Washington, DC
Reklaitis, G.V.; Ravindran, A.; Ragsdelli K.M. (1983) Engineering Optimization: Methods and Applications, John Wiley, New York
Drud, A. (1985) CONOPT: A GRG code for large sparse dynamic nonlinear optimization problems, Mathematical Programming, 31, 153–191
Patera, A.T. (1994) Personal communications
Prinz, F.B.; Weiss, L.E.; Amon, C.H.; Beuth, J.L. (1995) Processing, Thermal and Mechanical Issues in Shape Deposition Manufacturing, Solid Freeform Fabrication Proc., eds. H.L. Marcus et al., 118–129
Siewiorek, D.P.; Smailagic, A.; Lee, J.C.Y.; Tabatai, A.R.A. (1994) An interdisciplinary concurrent design methodology applied to the navigator wearable computer system, Journal of Computer and Software Engineering, 2, 259–292
Amon, C.H.; Nigen, J.; Siewiorek, D.P.; Smailagic, A.; Stivoric, J.M. (1995) Concurrent design and analysis of the navigator wearable computer system: the thermal perspective, IEEE Transactions on Computers, Packaging and Manufacturing technology, 3, 567–577
Patera, A.T. (1984) A spectral element method for fluid dynamics: laminar flow in a channel expansion, Journal of Computational Physics, 54, 468–488
Amon, C.H. (1993) Spectral element-Fourier method for transitional flows in complex geometries, AIAA Journal, 31, 1, 42–48
Amon, C.H. (1995) Spectral element-Fourier method for unsteady conjugate heat transfer in complex flow geometry flows, AIAA Journal of Thermophysics and Heat Transfer, 9, 2, 247–253
Egan, E.; Amon, C.H. (1996) Cooling strategies for embedded electronic components of wearable computers fabricated by shape deposition manufacturing, ITHERM'96, Fifth ASME/IEEE/ISHM/CPMT/NIST Conference on Thermal Phenomena in Electronic Systems, May
Campbell, M.I.; Amon, C.H.; Cagan, H. (1996) Optimal three-dimensional placement of heat generating electronic components, ASME Journal of Electronic Packaging (in press)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Osio, I.G., Amon, C.H. An engineering design methodology with multistage Bayesian surrogates and optimal sampling. Research in Engineering Design 8, 189–206 (1996). https://doi.org/10.1007/BF01597226
Issue Date:
DOI: https://doi.org/10.1007/BF01597226