Compara mètodes
Revisa els mètodes seleccionats l'un al costat de l'altre; les files que difereixen es ressalten.
| Optimització basada en substituts× | Optimització bayesiana× | |
|---|---|---|
| Camp | Optimització | Optimització |
| Família | Process / pipeline | Process / pipeline |
| Any d'origen≠ | 1989 (computer experiments formulation) | 1975 (foundational); 2012 (ML standard) |
| Autor original≠ | Sacks, Welch, Mitchell & Wynn (computer experiments framework, 1989); Kriging popularised by Matheron (1963) | Mockus (1975); popularised for ML by Snoek, Larochelle & Adams (2012) |
| Tipus≠ | Metamodel-assisted black-box optimization | Sequential model-based black-box optimization |
| Font seminal≠ | Forrester, A., Sobester, A., & Keane, A. (2008). Engineering Design via Surrogate Modelling: A Practical Guide. Wiley. link ↗ | Snoek, J., Larochelle, H., & Adams, R.P. (2012). Practical Bayesian Optimization of Machine Learning Algorithms. Advances in Neural Information Processing Systems (NeurIPS), 25. link ↗ |
| Àlies | Vekil Model Tabanlı Optimizasyon (Surrogate-Based), metamodel-assisted optimization, surrogate modelling, emulator-based optimization | Bayesçi Optimizasyon (Hyperparameter Tuning), surrogate-based optimization, sequential model-based optimization, SMBO |
| Relacionats≠ | 5 | 2 |
| Resum≠ | Surrogate-based optimization, formalized in the computer-experiments framework of Sacks et al. (1989) and popularized for engineering by Forrester et al. (2008), replaces a prohibitively expensive simulation or physical experiment with a cheap approximate model — called a surrogate or metamodel — and then optimizes that surrogate instead. The surrogate is typically a Kriging (Gaussian Process), Radial Basis Function, or polynomial response surface fitted to a small set of carefully chosen design evaluations and periodically updated as the search progresses. | Bayesian Optimization is a sequential, model-based strategy for finding the optimum of expensive black-box functions with as few evaluations as possible. Rooted in the work of Mockus (1975) and brought to mainstream machine-learning practice by Snoek, Larochelle, and Adams (2012), it fits a probabilistic surrogate model — typically a Gaussian Process — to past observations and uses an acquisition function to decide where to probe next, balancing exploration of unknown regions with exploitation of promising ones. |
| ScholarGateConjunt de dades ↗ |
|
|