Realist Evaluation
Also known as: Realistic Evaluation, Theory-Driven Realist Evaluation, CMO Configuration Analysis, Pawson-Tilley Evaluation
Realist evaluation is a theory-driven approach to evaluating programs and policies that asks not simply 'does it work?' but 'what works, for whom, in what circumstances, and why?'. Developed by Ray Pawson and Nick Tilley in their 1997 book Realistic Evaluation, it treats interventions as theories incarnate: programs offer resources or opportunities that trigger underlying mechanisms of reasoning and response in participants, and those mechanisms only fire in particular contexts. The unit of analysis is the Context-Mechanism-Outcome (CMO) configuration, and the goal is to build and refine middle-range theory that explains differential outcomes across settings.
Key highlights
- Explains heterogeneity of effects by design, identifying for whom and in what circumstances a program works rather than discarding variation as noise.
- Produces transferable middle-range theory, so lessons can be applied to new programs sharing the same mechanisms rather than being locked to one trial site.
- Method-neutral and explicitly mixed-methods, integrating quantitative outcome data with qualitative evidence on mechanisms within a single explanatory frame.
- Engages stakeholders' own theories, improving the relevance and uptake of findings among practitioners and policymakers.
Intuition
This section is available to Pro members. Upgrade to Pro
How it works
This section is available to Pro members. Upgrade to Pro
When to use it
Use realist evaluation when an intervention is complex, its effects vary markedly across sites or subgroups, and decision-makers need to understand the conditions under which it succeeds or fails rather than just an average impact. It is well suited to social programs, public-health initiatives, organisational reforms and policies implemented in heterogeneous settings where the same intervention plausibly works through different mechanisms. It is less appropriate when the question genuinely is a clean average treatment effect of a simple, standardised intervention, or when no articulable program theory exists. It complements rather than replaces counterfactual designs: an experiment may estimate whether an effect exists, while realist evaluation explains why and where.
Strengths & limitations
- Explains heterogeneity of effects by design, identifying for whom and in what circumstances a program works rather than discarding variation as noise.
- Produces transferable middle-range theory, so lessons can be applied to new programs sharing the same mechanisms rather than being locked to one trial site.
- Method-neutral and explicitly mixed-methods, integrating quantitative outcome data with qualitative evidence on mechanisms within a single explanatory frame.
- Engages stakeholders' own theories, improving the relevance and uptake of findings among practitioners and policymakers.
- Demanding to conduct well: specifying, testing and refining multiple CMO configurations requires substantial time, methodological skill and rich data.
- Mechanisms are unobservable generative processes that must be inferred, leaving room for divergent interpretation and weakening claims to objectivity.
- Provides no standardised effect size or confidence interval, which can frustrate audiences expecting quantified, comparable impact estimates.
- Quality is uneven across published realist evaluations, and the boundary between context and mechanism is contested and frequently applied inconsistently.
Common pitfalls
This section is available to Pro members. Upgrade to Pro
Applications
This section is available to Pro members. Upgrade to Pro
Frequently asked
What exactly is a mechanism in realist evaluation?
A mechanism is the underlying generative process through which a program produces its outcomes — usually a change in participants' reasoning, motivation, capacity or resources, not the program activity itself. For example, a job-training subsidy is the resource; the mechanism is the shift in an employer's calculation that hiring is now worthwhile, or in a jobseeker's sense of self-efficacy. Mechanisms are not directly observable and must be inferred from evidence, which is why specifying them carefully is the core analytic task.
How does realist evaluation differ from a theory of change or logic model?
A logic model or theory of change typically lays out a single linear chain from inputs to outcomes. Realist evaluation instead works with multiple Context-Mechanism-Outcome configurations and insists that the same program triggers different mechanisms in different contexts. It is explicitly about explaining variation and building transferable theory, whereas a logic model is usually a planning and communication device. The two are complementary: a theory of change can be a starting point that realist evaluation then interrogates and refines.
Can realist evaluation use randomised or quantitative data?
Yes. Realist evaluation is method-neutral: it draws on whatever data best test the CMO propositions. Quantitative and even experimental data are valuable for establishing outcome patterns and subgroup differences, but realism reframes them as evidence about which mechanisms fired in which contexts rather than as a single average treatment effect. The hallmark is the explanatory framework, not a prohibition on numbers.
Sources
- 1.Pawson, R., & Tilley, N. (1997). Realistic Evaluation. London: SAGE Publications.ISBN 9780761950097
- 2.Pawson, R. (2006). Evidence-Based Policy: A Realist Perspective. London: SAGE Publications.ISBN 9781412910606
You have read it. What now?
Cite this page
ScholarGate. (2026, June 22). Realist Evaluation. ScholarGate. https://scholargate.app/public-policy/realist-evaluation