Markov Chain Model in Health Economics
Markov Chain Model for Health Economic Evaluation · Also known as: Markov model, state transition model, cohort simulation
A Markov model is a decision-analytic tool that simulates disease progression through defined health states over time, calculating cumulative costs and quality-adjusted life years (QALYs) to enable cost-effectiveness analysis. Developed by Beck and Pauker in 1983, Markov models are now the standard framework for projecting long-term outcomes of health interventions, especially chronic diseases where patients transition between clinical states (treatment response, disease progression, remission, death). Used by health technology assessment bodies and pharmaceutical companies to predict intervention value beyond trial duration.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
When a health intervention affects disease progression over years or decades and trial data do not cover the full time horizon. Markov models are standard for: chronic disease management (diabetes, hypertension, HIV, cancer); long-term prevention (statins, vaccines); devices with durability questions (implants, cardiac devices); any intervention requiring extrapolation beyond trial duration. Mandatory in most HTA submissions (NICE, CADTH, HAS). Not needed for: acute interventions (one-time surgery) with short outcomes window; rare diseases with few patients (data sparse); situations where trials already cover lifetime (uncommon).
Strengths & limitations
- Integrates disease natural history with intervention effects: can model how drugs alter progression rates, enabling realistic long-term cost-effectiveness estimates beyond trial duration.
- Explicit and transparent: states, transition probabilities, costs, utilities are visible and auditable; reviewers can critique assumptions.
- Flexible: can accommodate complex disease pathways (remission, relapse, treatment switching), multiple interventions, patient heterogeneity (subgroup analysis).
- Computationally efficient: Markov models run in seconds on modern hardware; enables quick sensitivity and scenario analysis, unlike microsimulation.
- Markov memoryless assumption: future transitions depend only on current state, not disease history. This is violated if, e.g., a patient's prognosis depends on time spent in previous state (e.g., duration of remission predicts relapse risk). Alternative: 'tunnel states' (e.g., remission 1 year, remission >1 year) to approximate history-dependence, but increases complexity.
- State definition requires clinical judgment: If states are too broad (e.g., 'mild disease' vs 'severe disease'), transitions are heterogeneous and imprecise. Too many states (e.g., CD4 in 50-cell increments) inflates model complexity without precision gain.
- Transition probabilities often uncertain or borrowed: If trial only followed 5 years but model runs 20, later transition probabilities are extrapolated or assumed constant (not evidence-based). Small changes in transitions compound over time (parameter uncertainty).
- Does not capture individual variability: Markov is a cohort model (average pathways); discrete event simulation (alternative) tracks individual patient trajectories but is more complex.
- Cycle length choice is arbitrary: Annual cycles are standard, but disease progression may be faster (quarterly, monthly cycles needed) or slower (5-year cycles acceptable). Shorter cycles increase precision but also computation and uncertainty.
Frequently asked
What is the difference between a Markov model and a decision tree?
Decision trees branch at decision points (e.g., treat vs not treat) and show immediate outcomes (trial endpoints). Markov models simulate progression through states over many cycles, capturing disease natural history over years. Decision trees handle short-term, one-time decisions; Markov models handle chronic disease with ongoing transitions. Often combined: decision tree determines baseline/treatment assignment; then Markov models progression thereafter.
How are transition probabilities calibrated if trial data are incomplete?
Methods: (1) Published literature: search for cohort studies reporting transition rates for same patient population, same disease states. (2) Meta-analysis: if multiple small studies available, pool data to estimate transition probability. (3) Expert opinion: convene clinicians to estimate transitions if data absent (least rigorous). (4) Calibration: run model with estimated transitions; compare 5-year outcomes to published trial data; adjust transitions until model matches trial (reverse-engineering). Sensitivity analysis should reflect uncertainty in transitions.
Should Markov models include all clinically relevant health states?
No, include only states that materially affect cost or outcomes. Example: distinguishing CD4 100–150 from CD4 50–100 is clinically important (different treatment toxicity, mortality risk), so include both. Distinguishing CD4 501–520 from CD4 521–540 is probably immaterial; combine into CD4 >500. Rule of thumb: if a state change would alter clinical management or cost >10%, include it.
How are cycle length and discounting related?
Cycle length (annual, quarterly, monthly) determines how often transitions occur and when costs/QALYs are accrued. Shorter cycles (monthly) increase accuracy but computation time. Discounting is applied to each cycle's costs/QALYs: annual discount at 3% means Year 2 value × 1/1.03, Year 3 × 1/1.03², etc. If using quarterly cycles, adjust discount rate: quarterly = 3%^(1/4) ≈ 0.74% per quarter. Standard: annual cycles with annual 3% discount.
What is a 'tunnel state' and when is it needed?
Tunnel state captures how long a patient has been in a current state, violating the memoryless assumption. Example: CD4 'recently recovered' (on antiretroviral therapy <1 year) has higher risk of immune reconstitution inflammatory syndrome (IRIS) than CD4 'stable' (on therapy >1 year). Create two states: CD4 >500 (IRIS risk) and CD4 >500 (stable); transition between them after 1 year. Tunnel states increase model complexity but improve accuracy when history matters.
How is compliance/adherence incorporated into Markov models?
Option 1: Use real-world trial data from ITT (intention-to-treat) analysis that incorporates actual adherence. Option 2: Create separate states (adherent vs non-adherent) and model transitions (adherence slip-ups, re-engagement). Option 3: Reduce efficacy in model to reflect population-level adherence (e.g., if trial showed 80% adherence and efficacy assumed 70% of trial efficacy). Sensitivity analysis should explore impact of adherence assumptions.
Sources
- Beck, J. R., & Pauker, S. G. (1983). The Markov Process in Medical Prognosis. Medical Decision Making, 3(4), 419-458. DOI: 10.1177/0272989X8300300403 ↗
- Sonnenberg, F. A., & Beck, J. R. (1993). Markov Models in Medical Decision Making: A Practical Guide. Medical Decision Making, 13(4), 322-338. DOI: 10.1177/0272989X9301300409 ↗
- Drummond, M. F., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the Economic Evaluation of Health Care Programmes (4th ed.). Oxford: Oxford University Press. link ↗
How to cite this page
ScholarGate. (2026, June 4). Markov Chain Model for Health Economic Evaluation. ScholarGate. https://scholargate.app/en/health-economics/markov-model-health-economics
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Budget Impact AnalysisHealth Economics↔ compare
- Cost-Benefit AnalysisHealth Economics↔ compare
- Cost-Effectiveness AnalysisHealth Economics↔ compare
- Decision Analytic ModelingHealth Economics↔ compare
- Quality-Adjusted Life YearHealth Economics↔ compare