Effect Size Analysis
Also known as: effect magnitude estimation, standardized effect measure, practical significance analysis, ES analysis
Effect size analysis quantifies the practical magnitude of a statistical result independently of sample size. Rather than asking only whether a difference or relationship is statistically significant, it asks how large it is, using standardized indices such as Cohen's d, eta-squared, omega-squared, or Pearson's r that allow direct comparison across studies and populations.
Key highlights
- Scale-free and comparable across studies, designs, and measurement instruments.
- Essential input for a priori sample-size and power planning.
- Enables meta-analytic synthesis by providing a common quantitative currency.
- Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
- Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.
Intuition
This section is available to Pro members. Upgrade to Pro
How it works
This section is available to Pro members. Upgrade to Pro
When to use it
Use effect size analysis whenever you run an inferential test — it should accompany every t-test, ANOVA, chi-squared test, correlation, or regression model. It is indispensable when planning a study (power analysis requires an anticipated effect size), synthesising results across studies (meta-analysis), and communicating findings to practitioners who need to judge practical importance. Do not rely on effect sizes alone as a substitute for formal inference; they quantify magnitude but do not address whether that magnitude could be due to chance. Also avoid applying a single universal benchmark (e.g., d = 0.5 is always 'medium') without considering the specific field's norms, measurement precision, and the cost or benefit of the intervention.
Strengths & limitations
- Scale-free and comparable across studies, designs, and measurement instruments.
- Essential input for a priori sample-size and power planning.
- Enables meta-analytic synthesis by providing a common quantitative currency.
- Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
- Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.
- Cohen's benchmarks (small/medium/large) were derived from social science data and may not apply in other domains such as medicine, engineering, or education.
- Eta-squared is positively biased upward in small samples; omega-squared or partial eta-squared corrected for bias is preferable.
- Effect sizes do not convey the direction of practical benefit without substantive interpretation alongside the numerical value.
Common pitfalls
This section is available to Pro members. Upgrade to Pro
Applications
This section is available to Pro members. Upgrade to Pro
Frequently asked
Which effect size index should I use?
The choice depends on your design. Cohen's d is standard for two-group mean comparisons. Pearson's r or r-squared suits correlations and simple regressions. Eta-squared or omega-squared fits ANOVA designs. Cramer's V or phi is appropriate for chi-squared tests on categorical data. Hedges' g is preferred over Cohen's d when sample sizes differ across groups.
Is eta-squared or omega-squared better?
Omega-squared is preferred for inferential reporting because eta-squared is positively biased — it overestimates the population variance explained, especially in small samples. Eta-squared equals the sample proportion of variance explained and is useful for descriptive purposes, but omega-squared or intraclass correlation provides a less biased population estimate.
Do I still need p-values if I report effect sizes?
Yes. Effect sizes and p-values answer different questions. The p-value addresses whether the observed result is consistent with the null hypothesis given sampling variability. The effect size addresses how large the result is. Both are needed: a significant p with a tiny d suggests a real but negligible effect; a large d with a non-significant p suggests the study was underpowered.
Can I compute an effect size from published results without raw data?
Yes. Cohen's d can be recovered from a t statistic and sample sizes; r from t or F; eta-squared directly from the ANOVA table. Many meta-analytic calculators (e.g., the compute.es R package or the online effect size calculators) automate these conversions.
How do I interpret Cohen's benchmarks in applied fields?
Cohen's small/medium/large benchmarks were calibrated on social-science data and should be treated as rough defaults, not rigid rules. In high-stakes clinical or safety contexts, an effect of d = 0.2 may be very important. In cognitive psychology where effects are typically large, d = 0.5 may be unremarkable. Always contextualise against prior literature in your specific field.
Sources
- 1.Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.ISBN 978-0805802832
- 2.Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863.
You have read it. What now?
Cite this page
ScholarGate. (2026, June 3). Effect size analysis. ScholarGate. https://scholargate.app/statistics/effect-size-analysis