手法を比較

	マルコフモデル	動的計画法
分野	シミュレーション	最適化
系統	Process / pipeline	Process / pipeline
提唱年	1906	1957
提唱者	Andrei Markov	Richard Bellman
種類	Probabilistic state-transition model	Exact combinatorial optimization via recursive decomposition
原典	Norris, J. R. (1997). Markov Chains. Cambridge University Press, Cambridge. ISBN: 9780521633963	Bellman, R. (1957). Dynamic Programming. Princeton University Press. ISBN: 978-0-691-07951-6
別名	Markov Chain, Discrete-Time Markov Chain, DTMC, Markov Process	DP, Bellman's Principle of Optimality, Recursive Optimization, Dinamik Programlama
関連	5	3
概要	A Markov Model represents a system as a finite set of states and specifies the probability of moving from one state to another at each time step. By capturing only the current state — not the full history — it enables tractable analysis of complex dynamic processes across health economics, engineering reliability, operations research, and social-science modeling.	Dynamic Programming (DP) is an exact optimization technique introduced by Richard Bellman in 1957 for solving multi-stage decision problems. It decomposes a complex problem into simpler, overlapping subproblems, solves each subproblem once, and stores the results to avoid redundant computation. Grounded in the Principle of Optimality, DP guarantees globally optimal solutions whenever the problem exhibits overlapping subproblems and optimal substructure.