Effect Size Analysis
Also known as: effect magnitude estimation, standardized effect measure, practical significance analysis, ES analysis
Effect size analysis quantifies the practical magnitude of a statistical result independently of sample size. Rather than asking only whether a difference or relationship is statistically significant, it asks how large it is, using standardized indices such as Cohen's d, eta-squared, omega-squared, or Pearson's r that allow direct comparison across studies and populations.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use effect size analysis whenever you run an inferential test — it should accompany every t-test, ANOVA, chi-squared test, correlation, or regression model. It is indispensable when planning a study (power analysis requires an anticipated effect size), synthesising results across studies (meta-analysis), and communicating findings to practitioners who need to judge practical importance. Do not rely on effect sizes alone as a substitute for formal inference; they quantify magnitude but do not address whether that magnitude could be due to chance. Also avoid applying a single universal benchmark (e.g., d = 0.5 is always 'medium') without considering the specific field's norms, measurement precision, and the cost or benefit of the intervention.
Strengths & limitations
- Scale-free and comparable across studies, designs, and measurement instruments.
- Essential input for a priori sample-size and power planning.
- Enables meta-analytic synthesis by providing a common quantitative currency.
- Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
- Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.
- Cohen's benchmarks (small/medium/large) were derived from social science data and may not apply in other domains such as medicine, engineering, or education.
- Eta-squared is positively biased upward in small samples; omega-squared or partial eta-squared corrected for bias is preferable.
- Effect sizes do not convey the direction of practical benefit without substantive interpretation alongside the numerical value.
Frequently asked
Which effect size index should I use?
The choice depends on your design. Cohen's d is standard for two-group mean comparisons. Pearson's r or r-squared suits correlations and simple regressions. Eta-squared or omega-squared fits ANOVA designs. Cramer's V or phi is appropriate for chi-squared tests on categorical data. Hedges' g is preferred over Cohen's d when sample sizes differ across groups.
Is eta-squared or omega-squared better?
Omega-squared is preferred for inferential reporting because eta-squared is positively biased — it overestimates the population variance explained, especially in small samples. Eta-squared equals the sample proportion of variance explained and is useful for descriptive purposes, but omega-squared or intraclass correlation provides a less biased population estimate.
Do I still need p-values if I report effect sizes?
Yes. Effect sizes and p-values answer different questions. The p-value addresses whether the observed result is consistent with the null hypothesis given sampling variability. The effect size addresses how large the result is. Both are needed: a significant p with a tiny d suggests a real but negligible effect; a large d with a non-significant p suggests the study was underpowered.
Can I compute an effect size from published results without raw data?
Yes. Cohen's d can be recovered from a t statistic and sample sizes; r from t or F; eta-squared directly from the ANOVA table. Many meta-analytic calculators (e.g., the compute.es R package or the online effect size calculators) automate these conversions.
How do I interpret Cohen's benchmarks in applied fields?
Cohen's small/medium/large benchmarks were calibrated on social-science data and should be treated as rough defaults, not rigid rules. In high-stakes clinical or safety contexts, an effect of d = 0.2 may be very important. In cognitive psychology where effects are typically large, d = 0.5 may be unremarkable. Always contextualise against prior literature in your specific field.
Sources
- Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates. ISBN: 978-0805802832
- Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863. DOI: 10.3389/fpsyg.2013.00863 ↗
How to cite this page
ScholarGate. (2026, June 3). Effect Size Analysis. ScholarGate. https://scholargate.app/en/statistics/effect-size-analysis
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Independent samples t-testStatistics↔ compare
- One-way ANOVAStatistics↔ compare
- Power analysisStatistics↔ compare
- ROC analysisStatistics↔ compare