Surrogate-Based Optimization — Metamodel-Assisted Design
Surrogate-Based Optimization (Metamodel-Assisted Optimization) · Also known as: Vekil Model Tabanlı Optimizasyon (Surrogate-Based), metamodel-assisted optimization, surrogate modelling, emulator-based optimization
Surrogate-based optimization, formalized in the computer-experiments framework of Sacks et al. (1989) and popularized for engineering by Forrester et al. (2008), replaces a prohibitively expensive simulation or physical experiment with a cheap approximate model — called a surrogate or metamodel — and then optimizes that surrogate instead. The surrogate is typically a Kriging (Gaussian Process), Radial Basis Function, or polynomial response surface fitted to a small set of carefully chosen design evaluations and periodically updated as the search progresses.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Surrogate-based optimization is the right choice when the true objective function is so expensive to evaluate — through CFD, finite-element analysis, lab experiments, or multi-physics simulations — that only tens to a few hundred evaluations are affordable. The method requires that the true response be sufficiently smooth for a surrogate to approximate it; highly discontinuous or stochastic functions may require specialized surrogates or variance-reduction techniques. The design space should be continuous. A space-filling initial design (Latin Hypercube Sampling) and mandatory cross-validation of the surrogate are non-negotiable prerequisites.
Strengths & limitations
- Dramatically reduces the number of expensive true evaluations needed to find a near-optimal design.
- Kriging surrogates provide uncertainty estimates that enable principled infill strategies such as expected improvement.
- Works on black-box problems where no gradient information is available.
- Applicable across engineering, science, and any domain where simulation cost dominates.
- Reusable surrogate can answer multiple design questions without additional true evaluations.
- Surrogate accuracy degrades in high-dimensional spaces (the curse of dimensionality); typically practical up to ~20–50 design variables without dimensionality reduction.
- If the true function is highly discontinuous or multimodal, the surrogate may mis-represent it and guide the optimizer to a false optimum.
- The initial training budget must be set carefully; too few points produce a poor surrogate, too many defeat the purpose of avoiding expensive evaluations.
- Kriging fitting and optimization of the acquisition function add computational overhead that grows with training set size.
Frequently asked
Which surrogate type should I choose — Kriging, RBF, or polynomial?
Kriging (Gaussian Process) is the default for engineering design because it provides both a prediction and a pointwise uncertainty estimate, enabling principled infill strategies such as expected improvement. Radial Basis Functions are computationally lighter and scale somewhat better. Polynomial response surfaces are simple and interpretable but struggle with nonlinear or multimodal responses. Start with Kriging unless dimensionality or training-set size makes it impractical.
How many initial design points do I need?
A common rule of thumb is 10 times the number of design variables for the initial Latin Hypercube sample, though this depends on the smoothness of the response. Validation metrics (cross-validation R-squared, RMSE) should confirm the surrogate is adequate before optimization proceeds. Additional points are added through the infill loop rather than all at once.
Is surrogate-based optimization the same as Bayesian optimization?
They are closely related but not identical. Bayesian optimization is a specific form of surrogate-based optimization that uses a Gaussian Process surrogate with a probabilistic acquisition function (such as expected improvement) to select infill points. The broader surrogate-based optimization framework includes non-probabilistic surrogates (RBF, polynomial) and other infill criteria, so Bayesian optimization is a subset.
What if my simulation is noisy rather than deterministic?
Standard Kriging assumes a deterministic response. For stochastic simulators, a noise term must be added to the Kriging covariance model (nugget parameter or stochastic Kriging). Without this, the surrogate will over-fit to noise rather than the true trend and the optimizer will be misled.
Sources
- Forrester, A., Sobester, A., & Keane, A. (2008). Engineering Design via Surrogate Modelling: A Practical Guide. Wiley. link ↗
- Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989). Design and Analysis of Computer Experiments. Statistical Science, 4(4), 409-423. DOI: 10.1214/ss/1177012413 ↗
How to cite this page
ScholarGate. (2026, June 1). Surrogate-Based Optimization (Metamodel-Assisted Optimization). ScholarGate. https://scholargate.app/en/optimization/surrogate-optimization
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Bayesian OptimizationOptimization↔ compare
- Design of experimentsExperimental design↔ compare
- Evolutionary StrategyOptimization↔ compare
- Latin Hypercube SamplingSimulation↔ compare
- Response Surface MethodologyExperimental design↔ compare