手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| ベイズ動的計画法× | 確率的動的計画法× | |
|---|---|---|
| 分野 | シミュレーション | シミュレーション |
| 系統 | Process / pipeline | Process / pipeline |
| 提唱年≠ | 1957 (Bellman DP); Bayesian extensions 1990s–2000s | 1957 |
| 提唱者≠ | Bellman, R.; extended by Bayesian frameworks (Duff, Bertsekas) | Bellman, R.; formalized for stochastic settings by Puterman, M. L. |
| 種類≠ | Sequential optimization with Bayesian belief updating | Sequential optimization under uncertainty |
| 原典≠ | Bertsekas, D. P. (1995). Dynamic Programming and Optimal Control. Athena Scientific, Belmont, MA. ISBN: 9781886529267 | Bellman, R. (1957). Dynamic Programming. Princeton University Press, Princeton, NJ. ISBN: 9780486428093 |
| 別名 | BDP, Bayesian DP, Bayesian sequential optimization, Bayesian stochastic control | SDP, Markov Decision Process, MDP, Stochastic DP |
| 関連≠ | 4 | 6 |
| 概要≠ | Bayesian Dynamic Programming (BDP) combines Bellman's dynamic programming framework with Bayesian inference to optimize sequential decisions when transition probabilities or reward structures are unknown. At each stage, the agent updates beliefs about the environment using observed outcomes, then computes an optimal policy that explicitly accounts for both immediate rewards and the value of information gained through exploration. | Stochastic Dynamic Programming (SDP) is a mathematical optimization framework for sequential decision problems where outcomes are partly random. It extends Bellman's principle of optimality to stochastic environments, representing problems as Markov Decision Processes (MDPs) and computing optimal policies by solving recursive value equations over states and time periods. |
| ScholarGateデータセット ↗ |
|
|