Pragmatic Pretest-Posttest Experimental Design
Also known as: pragmatic pre-post design, real-world pretest-posttest study, effectiveness pre-post design, pragmatic before-after study
A pragmatic pretest-posttest experimental design combines the before-after measurement structure of the classic pre-post design with the real-world, high-external-validity ethos of pragmatic research. Participants are assessed on relevant outcomes before an intervention is delivered in routine or naturalistic conditions, then re-assessed afterward. The goal is to estimate the effectiveness of the intervention as it actually works in practice rather than under ideal, tightly controlled efficacy conditions.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a pragmatic pretest-posttest design when you need real-world effectiveness evidence for an intervention that is already being implemented or where a no-intervention control is ethically or practically unavailable. It suits implementation science, quality improvement, public health, and educational research contexts where external validity is the priority. Do not use it when causal attribution is essential and a control group can be formed — a randomized or quasi-experimental design with a comparator will be more credible. Also avoid it when testing a novel intervention whose mechanism has not yet been validated under controlled conditions; efficacy evidence should precede large-scale pragmatic evaluation.
Strengths & limitations
- High external validity — findings reflect what happens in routine practice settings with real practitioners and diverse participants.
- Simpler to conduct than fully randomized designs when random assignment is infeasible or unethical.
- Pre-post measurement controls for stable individual differences and provides a within-person baseline, increasing sensitivity.
- Aligns well with implementation science goals of understanding real-world adoption and impact.
- Acceptable to practitioners and policymakers who question whether efficacy trial results translate to their setting.
- Absence of a concurrent control group makes it impossible to rule out maturation, history, regression to the mean, and other threats to internal validity.
- Selection bias cannot be eliminated — participants who receive the intervention may differ systematically from those who do not.
- Pragmatic flexibility (variable dose, provider, setting) complicates interpretation of effect size and replication.
- Attrition in routine settings is often higher than in controlled trials, threatening the representativeness of the posttest sample.
Frequently asked
What makes a design 'pragmatic' rather than just 'real-world'?
Pragmatic is a deliberate methodological stance, not simply a label for any study done outside a lab. A pragmatic design explicitly relaxes typical efficacy-trial constraints on eligibility (broad inclusion), setting (routine sites), intervention delivery (flexible), and follow-up (minimal extra burden). The PRECIS-2 framework operationalizes this by rating each design dimension on a continuum from explanatory to pragmatic.
Can I add a control group to a pragmatic pretest-posttest design?
Yes — adding a concurrent control group (randomized or matched) strengthens causal inference substantially while retaining the pragmatic ethos. A pragmatic randomized controlled trial with pre-post measurement in both arms is the gold standard when feasible. The pretest-posttest-only structure is reserved for situations where a comparator is genuinely unavailable.
How do I handle regression to the mean in the analysis?
Use the pretest score as a covariate in an ANCOVA or regression model predicting posttest outcomes rather than analyzing raw change scores. ANCOVA absorbs the regression-to-the-mean artifact and provides more accurate estimates of intervention effects than a simple paired t-test on difference scores.
How many participants do I need?
Sample size depends on the expected effect size, the reliability of the pretest-posttest correlation, and acceptable Type I/II error rates. Because pre-post designs benefit from within-person correlation (typically r = 0.5–0.8 for stable outcomes), they require smaller samples than independent-groups designs for the same effect. A power analysis using paired-samples logic or ANCOVA should be conducted and reported.
When should I prefer a pragmatic field experiment over this design?
If you can randomize participants or clusters to treatment and control conditions in the real-world setting, a pragmatic field experiment (or cluster RCT) provides stronger causal evidence. Reserve the single-group pretest-posttest structure for situations where a control condition is genuinely unavailable — for example, when an entire organization adopts a policy simultaneously.
Sources
- Schwartz, D., & Lellouch, J. (1967). Explanatory and pragmatic attitudes in therapeutical trials. Journal of Chronic Diseases, 20(8), 637-648. DOI: 10.1016/0021-9681(67)90041-0 ↗
- Campbell, D. T., & Stanley, J. C. (1963). Experimental and Quasi-Experimental Designs for Research. Rand McNally. ISBN: 978-0395307878
How to cite this page
ScholarGate. (2026, June 3). Pragmatic Pretest-Posttest Experimental Design. ScholarGate. https://scholargate.app/en/experimental-design/pragmatic-pretest-posttest-experimental-design
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Crossover Pretest-Posttest Experimental DesignExperimental design↔ compare
- Natural ExperimentExperimental design↔ compare
- Pragmatic Field ExperimentExperimental design↔ compare
- Pragmatic Randomized Controlled TrialExperimental design↔ compare
- Pretest-Posttest Experimental DesignExperimental design↔ compare