Сравнение на методи

	Оптимизация, базирана на заместващи модели	Байесовска оптимизация
Област	Оптимизация	Оптимизация
Семейство	Process / pipeline	Process / pipeline
Година на възникване	1989 (computer experiments formulation)	1975 (foundational); 2012 (ML standard)
Създател	Sacks, Welch, Mitchell & Wynn (computer experiments framework, 1989); Kriging popularised by Matheron (1963)	Mockus (1975); popularised for ML by Snoek, Larochelle & Adams (2012)
Тип	Metamodel-assisted black-box optimization	Sequential model-based black-box optimization
Основополагащ източник	Forrester, A., Sobester, A., & Keane, A. (2008). Engineering Design via Surrogate Modelling: A Practical Guide. Wiley.	Snoek, J., Larochelle, H., & Adams, R.P. (2012). Practical Bayesian Optimization of Machine Learning Algorithms. Advances in Neural Information Processing Systems (NeurIPS), 25.
Други названия	Vekil Model Tabanlı Optimizasyon (Surrogate-Based), metamodel-assisted optimization, surrogate modelling, emulator-based optimization	Bayesçi Optimizasyon (Hyperparameter Tuning), surrogate-based optimization, sequential model-based optimization, SMBO
Свързани	5	2
Резюме	Surrogate-based optimization, formalized in the computer-experiments framework of Sacks et al. (1989) and popularized for engineering by Forrester et al. (2008), replaces a prohibitively expensive simulation or physical experiment with a cheap approximate model — called a surrogate or metamodel — and then optimizes that surrogate instead. The surrogate is typically a Kriging (Gaussian Process), Radial Basis Function, or polynomial response surface fitted to a small set of carefully chosen design evaluations and periodically updated as the search progresses.	Bayesian Optimization is a sequential, model-based strategy for finding the optimum of expensive black-box functions with as few evaluations as possible. Rooted in the work of Mockus (1975) and brought to mainstream machine-learning practice by Snoek, Larochelle, and Adams (2012), it fits a probabilistic surrogate model — typically a Gaussian Process — to past observations and uses an acquisition function to decide where to probe next, balancing exploration of unknown regions with exploitation of promising ones.