Hypothesis testStatisticsClassical statisticsTest

Effect Size Analysis

Also known as: effect magnitude estimation, standardized effect measure, practical significance analysis, ES analysis

OriginatorJacob CohenYear1969 (first edition); 1988 (definitive second edition)Sources2Related methods11

Effect size analysis quantifies the practical magnitude of a statistical result independently of sample size. Rather than asking only whether a difference or relationship is statistically significant, it asks how large it is, using standardized indices such as Cohen's d, eta-squared, omega-squared, or Pearson's r that allow direct comparison across studies and populations.

Key highlights

  • Scale-free and comparable across studies, designs, and measurement instruments.
  • Essential input for a priori sample-size and power planning.
  • Enables meta-analytic synthesis by providing a common quantitative currency.
  • Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
  • Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.

Intuition

This section is available to Pro members. Upgrade to Pro

How it works

This section is available to Pro members. Upgrade to Pro

When to use it

Use effect size analysis whenever you run an inferential test — it should accompany every t-test, ANOVA, chi-squared test, correlation, or regression model. It is indispensable when planning a study (power analysis requires an anticipated effect size), synthesising results across studies (meta-analysis), and communicating findings to practitioners who need to judge practical importance. Do not rely on effect sizes alone as a substitute for formal inference; they quantify magnitude but do not address whether that magnitude could be due to chance. Also avoid applying a single universal benchmark (e.g., d = 0.5 is always 'medium') without considering the specific field's norms, measurement precision, and the cost or benefit of the intervention.

Strengths & limitations

Strengths
  • Scale-free and comparable across studies, designs, and measurement instruments.
  • Essential input for a priori sample-size and power planning.
  • Enables meta-analytic synthesis by providing a common quantitative currency.
  • Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
  • Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.
Limitations
  • Cohen's benchmarks (small/medium/large) were derived from social science data and may not apply in other domains such as medicine, engineering, or education.
  • Eta-squared is positively biased upward in small samples; omega-squared or partial eta-squared corrected for bias is preferable.
  • Effect sizes do not convey the direction of practical benefit without substantive interpretation alongside the numerical value.

Common pitfalls

This section is available to Pro members. Upgrade to Pro

Applications

This section is available to Pro members. Upgrade to Pro

Frequently asked

Which effect size index should I use?

The choice depends on your design. Cohen's d is standard for two-group mean comparisons. Pearson's r or r-squared suits correlations and simple regressions. Eta-squared or omega-squared fits ANOVA designs. Cramer's V or phi is appropriate for chi-squared tests on categorical data. Hedges' g is preferred over Cohen's d when sample sizes differ across groups.

Is eta-squared or omega-squared better?

Omega-squared is preferred for inferential reporting because eta-squared is positively biased — it overestimates the population variance explained, especially in small samples. Eta-squared equals the sample proportion of variance explained and is useful for descriptive purposes, but omega-squared or intraclass correlation provides a less biased population estimate.

Do I still need p-values if I report effect sizes?

Yes. Effect sizes and p-values answer different questions. The p-value addresses whether the observed result is consistent with the null hypothesis given sampling variability. The effect size addresses how large the result is. Both are needed: a significant p with a tiny d suggests a real but negligible effect; a large d with a non-significant p suggests the study was underpowered.

Can I compute an effect size from published results without raw data?

Yes. Cohen's d can be recovered from a t statistic and sample sizes; r from t or F; eta-squared directly from the ANOVA table. Many meta-analytic calculators (e.g., the compute.es R package or the online effect size calculators) automate these conversions.

How do I interpret Cohen's benchmarks in applied fields?

Cohen's small/medium/large benchmarks were calibrated on social-science data and should be treated as rough defaults, not rigid rules. In high-stakes clinical or safety contexts, an effect of d = 0.2 may be very important. In cognitive psychology where effects are typically large, d = 0.5 may be unremarkable. Always contextualise against prior literature in your specific field.

Sources

  1. 1.
    Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.
    ISBN 978-0805802832
  2. 2.
    Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863.

You have read it. What now?

Cite this page

ScholarGate. (2026, June 3). Effect size analysis. ScholarGate. https://scholargate.app/statistics/effect-size-analysis