Pilot Pretest-Posttest Experimental Design
Also known as: pilot pretest-posttest study, small-scale pretest-posttest trial, feasibility pretest-posttest design, pilot two-group pretest-posttest
A pilot pretest-posttest experimental design is a small-scale, preliminary study that applies a pretest-posttest measurement framework to a limited sample before a full-scale experiment. Its primary goals are to assess the feasibility of procedures, estimate effect sizes for power analysis, identify instrument problems, and uncover logistical barriers — all before committing to the cost and scale of a definitive trial. It combines the internal-validity advantages of repeated measurement with the pragmatic scope of a pilot study.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a pilot pretest-posttest design when you are planning a full-scale experiment and need preliminary evidence on feasibility (recruitment, retention, protocol adherence) and a preliminary effect-size estimate for power analysis. It is especially appropriate when the intervention is novel, the target population is hard to reach, or the measurement instrument has not been validated in the exact context. Do NOT use it as a substitute for the definitive study: pilot samples are too small for confirmatory inference, and p-values from pilot studies should not drive go/no-go decisions in isolation. Avoid it when ethical constraints prohibit withholding the intervention from a control group, or when a full trial is already feasible without the intermediate step.
Strengths & limitations
- Provides empirical, context-specific effect-size estimates for accurate sample-size calculation in the full study.
- Reveals procedural problems — dropout, instrument ceiling effects, protocol deviations — before they undermine a larger investment.
- The pretest-posttest structure allows within-person change detection even in very small samples, improving sensitivity over a posttest-only pilot.
- Builds researcher competence and participant familiarity with the intervention and measurement protocol.
- Can inform instrument refinement, dosing decisions, and control-condition choices before the definitive trial is committed.
- Small sample sizes make effect-size estimates highly imprecise; confidence intervals are typically wide and should not be mistaken for definitive findings.
- Significance testing on pilot data is unreliable and can produce false positives that mislead the decision to proceed.
- Pretest exposure may sensitise participants to the intervention or instrument, introducing testing effects that do not generalise to the full study.
- Pilot findings may not transfer to the larger study if the pilot sample differs systematically from the intended full population.
Frequently asked
How large should a pilot pretest-posttest sample be?
Common guidance suggests 12–40 participants in total, sometimes cited as a minimum of 12 per arm. The goal is not statistical power for the primary outcome but sufficient precision to estimate feasibility parameters and a rough effect size. Sample size rules of thumb (e.g., n=30) are approximate; the target should be justified by the specific feasibility questions being asked.
Should I include a control group in my pilot?
Including a control group improves the interpretability of the effect-size estimate and more closely mirrors the full-trial design, but it halves the per-group n for a given total. If the main concern is instrument functioning or retention, a one-group pilot may be sufficient. If baseline equivalence and between-group effect estimation are critical, include a comparison group even in the pilot.
Can I use pilot results to adjust my primary outcome or hypothesis before the full study?
Yes — that is one legitimate purpose of a pilot. However, the adjusted hypothesis or primary outcome for the full study should be pre-registered before data collection begins, and the pilot data must not be used again in the confirmatory analysis to avoid double-dipping and inflated Type I error rates.
Is a pilot pretest-posttest design the same as a quasi-experiment?
Not necessarily. The pilot design describes scale and purpose (small, preparatory); the pretest-posttest structure describes measurement timing. The underlying design may be fully experimental (randomised) or quasi-experimental (non-randomised). Many pilot pretest-posttest studies are quasi-experimental because randomisation at small scale is logistically difficult, but randomised pilot trials also exist.
What reporting standard should I follow when publishing a pilot study?
The CONSORT 2010 extension for pilot and feasibility trials (Eldridge et al., 2016, BMJ) is the most widely accepted standard. It requires explicit labelling as a pilot study, reporting of feasibility outcomes alongside effect estimates, and clear statements that the study was not powered for confirmatory inference.
Sources
- Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. In N. L. Gage (Ed.), Handbook of Research on Teaching (pp. 171–246). Rand McNally. link ↗
- Leon, A. C., Davis, L. L., & Kraemer, H. C. (2011). The role and interpretation of pilot studies in clinical research. Journal of Psychiatric Research, 45(5), 626–629. DOI: 10.1016/j.jpsychires.2010.10.008 ↗
How to cite this page
ScholarGate. (2026, June 3). Pilot Pretest-Posttest Experimental Design. ScholarGate. https://scholargate.app/en/experimental-design/pilot-pretest-posttest-experimental-design
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Randomized Controlled TrialExperimental design↔ compare