Theory-Based Impact Evaluation
Also known as: Theory of Change Evaluation, Contribution Analysis, Theory-Driven Evaluation, Causal-Chain Impact Evaluation
Theory-based impact evaluation evaluates a programme by first making explicit the theory of change — the causal chain of assumptions and mechanisms through which inputs are expected to produce outcomes and impacts — and then gathering evidence to test whether each link in that chain holds. Rather than treating the programme as a black box and estimating only the net effect, it asks not just whether a programme worked but why, for whom, and under what conditions. Articulated by Carol Weiss and brought into development practice by Howard White and 3ie, it complements, rather than competes with, counterfactual designs.
Key highlights
- Explains the mechanism — why, how, and for whom a programme works — rather than treating impact as a black box.
- Helps distinguish theory failure (a flawed programme design) from implementation failure (a sound design poorly executed).
- Applicable to complex, multi-component, and non-randomisable interventions where pure counterfactual designs are infeasible.
- Supports transferable learning and policy uptake by clarifying which mechanisms and conditions drive results.
Intuition
This section is available to Pro members. Upgrade to Pro
How it works
This section is available to Pro members. Upgrade to Pro
When to use it
Use theory-based impact evaluation when you need to understand the mechanism behind a result — why and how a programme works — not merely whether it worked, and especially for complex, multi-component, or context-dependent interventions where a single counterfactual estimate would be uninformative. It is well suited to programmes that cannot be randomised, to explaining heterogeneous or null results, and to drawing transferable lessons. It is weaker as a stand-alone basis for net-effect attribution where a credible counterfactual is feasible; its rigour depends on the quality of the underlying theory and evidence, and a poorly specified theory of change yields a weak evaluation.
Strengths & limitations
- Explains the mechanism — why, how, and for whom a programme works — rather than treating impact as a black box.
- Helps distinguish theory failure (a flawed programme design) from implementation failure (a sound design poorly executed).
- Applicable to complex, multi-component, and non-randomisable interventions where pure counterfactual designs are infeasible.
- Supports transferable learning and policy uptake by clarifying which mechanisms and conditions drive results.
- On its own it provides weaker net-effect attribution than a credible counterfactual design when one is available.
- Quality depends heavily on the soundness of the articulated theory of change; a weak or biased theory yields a weak evaluation.
- Judgements of contribution can be subjective and harder to standardise or replicate than a quantitative effect estimate.
- Mapping and testing a full causal chain with mixed methods can be data-intensive, time-consuming, and demanding of evaluator skill.
Common pitfalls
This section is available to Pro members. Upgrade to Pro
Applications
This section is available to Pro members. Upgrade to Pro
Frequently asked
How does theory-based impact evaluation differ from a randomized controlled trial?
A randomized controlled trial estimates the net effect of a programme by comparing randomly assigned treatment and control groups, answering whether it worked but treating the programme as a black box. Theory-based impact evaluation instead specifies the causal chain and tests each link with mixed evidence, answering why and how it worked. The two are complementary: the strongest evaluations embed an explicit theory of change within an experimental or quasi-experimental design, so that the net effect and the mechanism behind it are estimated together.
What is contribution analysis?
Contribution analysis, developed by John Mayne, is a structured approach to causal inference where attribution is impossible or impractical. It builds a postulated theory of change, gathers evidence on whether each link occurred and whether alternative explanations can be discounted, and assembles a reasoned 'contribution story' that judges how plausibly the intervention contributed to the observed result. Rather than claiming the programme caused an exact effect size, it argues that, given the evidence and the ruling-out of rival causes, the programme made a credible difference.
Is a theory of change the same as a logframe?
No. A logical framework (logframe) is a management matrix linking inputs, activities, outputs, outcomes, and indicators, often in a linear table. A theory of change is richer: it makes explicit the causal mechanisms, behavioural responses, contextual conditions, and assumptions that connect each level, including feedback loops and alternative pathways. A theory of change can underpin a logframe, but a logframe alone usually omits the why — the mechanisms and assumptions — that theory-based evaluation needs to test.
Sources
- 1.White, H. (2009). Theory-Based Impact Evaluation: Principles and Practice. Journal of Development Effectiveness, 1(3), 271–284.
- 2.Weiss, C. H. (1997). Theory-based evaluation: Past, present, and future. New Directions for Evaluation, 1997(76), 41–55.
You have read it. What now?
Cite this page
ScholarGate. (2026, June 22). Theory-Based Impact Evaluation. ScholarGate. https://scholargate.app/development-studies/theory-based-impact-evaluation