Solomon Four-Group Design — Controlling Pretest Sensitization
Solomon Four-Group Experimental Design · Also known as: Solomon design, four-group design, Solomon four-group control design, S4GD
The Solomon Four-Group Design extends the classic pretest-posttest control-group design by adding two groups that receive no pretest, enabling researchers to detect whether the pretest itself alters participants' responses to the treatment. Introduced by Richard L. Solomon in 1949, it remains the gold standard for isolating the independent effect of a pretest and for obtaining unbiased estimates of treatment efficacy.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+6 more
When to use it
Use the Solomon Four-Group Design when you suspect that completing a pretest might change how participants respond to the intervention — common in attitude-change studies, educational research, health behavior interventions, and any domain where answering baseline questions could raise awareness or prime responses. It is most valuable when sensitization is theoretically plausible and the cost of doubling the sample is acceptable. Avoid it when the research budget allows only a small total sample (each of the four groups must be large enough to detect effects independently), when the phenomenon of interest is immune to measurement reactivity, or when pretest data are essential for individual-level tracking — in those cases a standard pretest-posttest design with ANCOVA is more practical.
Strengths & limitations
- Uniquely identifies and quantifies the pretest sensitization (testing) effect, which simpler designs confound with the treatment effect.
- Produces the most internally valid estimate of treatment efficacy by combining evidence from both pretested and unpretested groups.
- Supports a full 2 × 2 factorial ANOVA, yielding main effects for treatment and pretesting as well as their interaction.
- Random assignment to all four groups supports causal inference for both treatment and pretest effects simultaneously.
- Provides a built-in replication: the treatment effect can be estimated twice (from Groups 1 vs. 2 and from Groups 3 vs. 4) and the two estimates should converge if the design assumptions hold.
- Requires roughly twice the sample size of a standard pretest-posttest design, making it expensive and logistically demanding.
- Statistical analysis is complex relative to simple pre-post comparisons; ANCOVA on the subset with pretest data requires careful handling of missing covariates for Groups 3 and 4.
- Does not control for history or maturation effects beyond what randomization provides; these threats apply to all four groups equally.
- Rarely used in practice because the sensitization assumption is often untested rather than theoretically motivated, and the sample cost is high.
Frequently asked
How do I handle the missing pretest scores for Groups 3 and 4 in the analysis?
The recommended approach is a 2 × 2 factorial ANOVA on the four posttest means, treating treatment condition and pretest presence as the two factors. This uses all data without requiring pretest scores for all groups. Alternatively, for Groups 1 and 2 you can run ANCOVA with the pretest as a covariate and compare the ANCOVA-adjusted treatment effect to the unadjusted one from Groups 3 and 4. The two estimates should be close if sensitization is absent.
How large does each group need to be?
Each of the four cells should be powered to detect the expected effect size for the key comparison. Because the interaction (Treatment × Pretest) is typically the test of greatest interest and interaction effects require larger samples than main effects, plan for at least 30–50 participants per cell in most social science contexts, or use an a priori power analysis with your expected effect size and a power of 0.80.
What if the interaction term is not significant?
A non-significant Treatment × Pretest interaction is a useful finding: it indicates that pretesting did not sensitize participants, and the simpler pretest-posttest control-group design would have been adequate. In that case, pool the treatment main effect across both pretest conditions for your primary conclusion.
Is the Solomon design ever used in clinical trials?
Rarely. Clinical trials typically prioritize blinding and cannot always withhold baseline assessments ethically or practically. The design is more common in social, educational, and psychological research where the sensitization threat is more pronounced and withholding a pretest raises no ethical concerns.
What distinguishes the Solomon design from a 2 × 2 factorial experiment?
Structurally it is a 2 × 2 factorial (treatment × pretest), but the 'pretest' factor is not a manipulated treatment variable — it is a design feature whose presence or absence is assigned to control a nuisance. The Solomon design is therefore better understood as a method for purifying causal inference about the main treatment than as a factorial study of two independent factors.
Sources
- Solomon, R. L. (1949). An extension of control group design. Psychological Bulletin, 46(2), 137–150. DOI: 10.1037/h0062958 ↗
- Campbell, D. T., & Stanley, J. C. (1963). Experimental and Quasi-Experimental Designs for Research. Rand McNally. ISBN: 978-0395307878
How to cite this page
ScholarGate. (2026, June 3). Solomon Four-Group Experimental Design. ScholarGate. https://scholargate.app/en/experimental-design/solomon-four-group-design
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Analysis of Variance (ANOVA)Research Statistics↔ compare
- Control Group Experimental DesignExperimental design↔ compare
- Factorial ExperimentExperimental design↔ compare
- Pretest-Posttest Experimental DesignExperimental design↔ compare
- Randomized Controlled TrialExperimental design↔ compare