Порівняння методів
Переглядайте обрані методи поруч; рядки з відмінностями підсвічено.
| Байєсівське динамічне програмування× | Стохастичне динамічне програмування× | |
|---|---|---|
| Галузь | Імітаційне моделювання | Імітаційне моделювання |
| Родина | Process / pipeline | Process / pipeline |
| Рік появи≠ | 1957 (Bellman DP); Bayesian extensions 1990s–2000s | 1957 |
| Автор методу≠ | Bellman, R.; extended by Bayesian frameworks (Duff, Bertsekas) | Bellman, R.; formalized for stochastic settings by Puterman, M. L. |
| Тип≠ | Sequential optimization with Bayesian belief updating | Sequential optimization under uncertainty |
| Основоположне джерело≠ | Bertsekas, D. P. (1995). Dynamic Programming and Optimal Control. Athena Scientific, Belmont, MA. ISBN: 9781886529267 | Bellman, R. (1957). Dynamic Programming. Princeton University Press, Princeton, NJ. ISBN: 9780486428093 |
| Інші назви | BDP, Bayesian DP, Bayesian sequential optimization, Bayesian stochastic control | SDP, Markov Decision Process, MDP, Stochastic DP |
| Пов'язані≠ | 4 | 6 |
| Підсумок≠ | Bayesian Dynamic Programming (BDP) combines Bellman's dynamic programming framework with Bayesian inference to optimize sequential decisions when transition probabilities or reward structures are unknown. At each stage, the agent updates beliefs about the environment using observed outcomes, then computes an optimal policy that explicitly accounts for both immediate rewards and the value of information gained through exploration. | Stochastic Dynamic Programming (SDP) is a mathematical optimization framework for sequential decision problems where outcomes are partly random. It extends Bellman's principle of optimality to stochastic environments, representing problems as Markov Decision Processes (MDPs) and computing optimal policies by solving recursive value equations over states and time periods. |
| ScholarGateНабір даних ↗ |
|
|