Analysis of Variance (ANOVA)
Analysis of Variance · Also known as: ANOVA, F-test
ANOVA is a parametric statistical method developed by Ronald A. Fisher in 1925 that tests whether means differ significantly across three or more independent groups. By partitioning total variance into between-group and within-group components, ANOVA determines whether observed differences are likely due to treatment effects or random variation, making it fundamental to comparative research across medicine, psychology, agriculture, and engineering.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use ANOVA when comparing means of three or more independent groups on a continuous outcome. Common scenarios: testing effectiveness of multiple treatment conditions (education, medicine), comparing outcomes across demographic categories (age groups, geographic regions), or evaluating multiple intervention arms in a randomized trial. ANOVA is ideal when data are approximately normally distributed and group variances are roughly equal. For non-normal data, consider Kruskal-Wallis (nonparametric alternative). For repeated measures (same subjects measured multiple times), use repeated measures ANOVA. For nested data (students within schools), use multilevel modeling.
Strengths & limitations
- Powerful for detecting true group differences when assumptions are met; maintains lower Type I error rate than multiple t-tests.
- Parsimonious: tests overall group effect in a single model rather than conducting many pairwise comparisons.
- Provides effect size (eta-squared) quantifying the magnitude of group differences relative to overall variation.
- Widely available in statistical software; standard practice in research across disciplines; results easily communicated.
- Extensible: foundation for factorial ANOVA (multiple factors), multivariate ANOVA (MANOVA), repeated measures designs, and mixed models.
- Assumes normally distributed residuals; sensitive to departures from normality with large effect sizes or unequal group sizes.
- Homogeneity of variance assumption: unequal variances across groups inflate Type I error. Welch's F is more robust alternative.
- Omnibus test: a significant p-value indicates at least two means differ, but does not specify which pairs; post-hoc testing adds complexity and multiple comparison penalties.
- Sensitive to outliers: a few extreme observations can inflate within-group variance and reduce statistical power.
- Requires independent observations; violates assumptions if data are clustered (e.g., students nested in classrooms) without appropriate adjustment.
Frequently asked
What is the difference between one-way, two-way, and repeated measures ANOVA?
One-way ANOVA tests one independent variable (factor) with multiple levels (e.g., three treatment groups). Two-way ANOVA includes two independent variables and tests main effects and their interaction (e.g., treatment and gender effects on outcome). Repeated measures ANOVA applies to within-subjects designs where the same individuals are measured multiple times (e.g., before, during, after treatment); it accounts for correlation between repeated observations. Choice depends on study design and research questions.
When should I use post-hoc tests, and which one is best?
Use post-hoc tests only after a significant omnibus ANOVA to identify which group pairs differ. Tukey HSD (Honestly Significant Difference) is standard for equal group sizes and planned pairwise comparisons, controlling familywise error. Bonferroni is conservative (stricter, fewer false positives) for few comparisons. Scheffé is most flexible, allowing complex contrasts. Dunnett's test is best for comparing multiple treatment groups to a single control. Always specify post-hoc tests in advance; data-driven selection inflates Type I error.
How do I handle unequal sample sizes across groups?
Unequal n is not a violation if missing data are missing completely at random (MCAR). Type I error control is robust under unequal n. However, post-hoc tests assume equal group sizes; use modified critical values or alternative tests (e.g., Games-Howell) to adjust for unequal variances and sample sizes. Report group sizes explicitly. If missingness is related to variables of interest, consider multiple imputation or mixed models to handle missing data appropriately.
What is eta-squared (η²) and how does it differ from omega-squared (ω²)?
Both measure effect size: the proportion of total variance explained by group membership. Eta-squared (η² = SS_between / SS_total) is easier to calculate but biased upward, especially with small samples. Omega-squared (ω² = (SS_between − (k−1)MS_within) / (SS_total + MS_within)) corrects this bias and provides a less inflated estimate of population effect size. For publication, report omega-squared for accuracy. Rough benchmarks: 0.01 = small, 0.06 = medium, 0.14 = large effect.
Sources
- Fisher, R. A. (1925). Statistical Methods for Research Workers. Oliver and Boyd. link ↗
- Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, 47(260), 583–621. DOI: 10.1080/01621459.1952.10483441 ↗
How to cite this page
ScholarGate. (2026, June 4). Analysis of Variance. ScholarGate. https://scholargate.app/en/research-statistics/analysis-of-variance
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Factor AnalysisResearch Statistics↔ compare
- Multilevel ModelingResearch Statistics↔ compare
- Multiple Regression AnalysisResearch Statistics↔ compare
- Nonparametric Statistical TestsResearch Statistics↔ compare