Skip to contentScholarGate
LibraryBookshelfDeskReview StudioAssistant
Sign in
On this page
IntuitionHow it worksWhen to use itStrengths & limitationsCommon pitfallsApplicationsFrequently asked🔒 Read the full methodSourcesRelated methods
Cite this pageSpotted an issue on this page? Report or suggest a fix →
Home›Statistics›Effect Size Analysis
Hypothesis testClassical statistics

Effect Size Analysis

Also known as: effect magnitude estimation, standardized effect measure, practical significance analysis, ES analysis

Effect size analysis quantifies the practical magnitude of a statistical result independently of sample size. Rather than asking only whether a difference or relationship is statistically significant, it asks how large it is, using standardized indices such as Cohen's d, eta-squared, omega-squared, or Pearson's r that allow direct comparison across studies and populations.

ScholarGate
  1. Hypothesis test
  2. v1
  3. 2 Sources
  4. PUBLISHED
Cite this page →
Tools & resources
Download slides
Learn & explore

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Method map

The neighbourhood of related methods — select a node to explore.

Effect size analysis
Independent samples t-te…One-way ANOVAPower analysisROC analysisBayesian descriptive sta…Kendall's tauRobust Descriptive Stati…Robust Effect Size Analy…Robust power analysis

When to use it

Use effect size analysis whenever you run an inferential test — it should accompany every t-test, ANOVA, chi-squared test, correlation, or regression model. It is indispensable when planning a study (power analysis requires an anticipated effect size), synthesising results across studies (meta-analysis), and communicating findings to practitioners who need to judge practical importance. Do not rely on effect sizes alone as a substitute for formal inference; they quantify magnitude but do not address whether that magnitude could be due to chance. Also avoid applying a single universal benchmark (e.g., d = 0.5 is always 'medium') without considering the specific field's norms, measurement precision, and the cost or benefit of the intervention.

Strengths & limitations

Strengths
  • Scale-free and comparable across studies, designs, and measurement instruments.
  • Essential input for a priori sample-size and power planning.
  • Enables meta-analytic synthesis by providing a common quantitative currency.
  • Distinguishes practical importance from statistical significance, preventing over-interpretation of large-N results.
  • Many indices (d, r, eta-squared) can be back-calculated from standard test statistics when raw data are unavailable.
Limitations
  • Cohen's benchmarks (small/medium/large) were derived from social science data and may not apply in other domains such as medicine, engineering, or education.
  • Eta-squared is positively biased upward in small samples; omega-squared or partial eta-squared corrected for bias is preferable.
  • Effect sizes do not convey the direction of practical benefit without substantive interpretation alongside the numerical value.

Frequently asked

Which effect size index should I use?

The choice depends on your design. Cohen's d is standard for two-group mean comparisons. Pearson's r or r-squared suits correlations and simple regressions. Eta-squared or omega-squared fits ANOVA designs. Cramer's V or phi is appropriate for chi-squared tests on categorical data. Hedges' g is preferred over Cohen's d when sample sizes differ across groups.

Is eta-squared or omega-squared better?

Omega-squared is preferred for inferential reporting because eta-squared is positively biased — it overestimates the population variance explained, especially in small samples. Eta-squared equals the sample proportion of variance explained and is useful for descriptive purposes, but omega-squared or intraclass correlation provides a less biased population estimate.

Do I still need p-values if I report effect sizes?

Yes. Effect sizes and p-values answer different questions. The p-value addresses whether the observed result is consistent with the null hypothesis given sampling variability. The effect size addresses how large the result is. Both are needed: a significant p with a tiny d suggests a real but negligible effect; a large d with a non-significant p suggests the study was underpowered.

Can I compute an effect size from published results without raw data?

Yes. Cohen's d can be recovered from a t statistic and sample sizes; r from t or F; eta-squared directly from the ANOVA table. Many meta-analytic calculators (e.g., the compute.es R package or the online effect size calculators) automate these conversions.

How do I interpret Cohen's benchmarks in applied fields?

Cohen's small/medium/large benchmarks were calibrated on social-science data and should be treated as rough defaults, not rigid rules. In high-stakes clinical or safety contexts, an effect of d = 0.2 may be very important. In cognitive psychology where effects are typically large, d = 0.5 may be unremarkable. Always contextualise against prior literature in your specific field.

Sources

  1. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates. ISBN: 978-0805802832
  2. Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863. DOI: 10.3389/fpsyg.2013.00863 ↗

How to cite this page

ScholarGate. (2026, June 3). Effect Size Analysis. ScholarGate. https://scholargate.app/en/statistics/effect-size-analysis

Related methods

Independent samples t-testOne-way ANOVAPower analysisROC analysis

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

  • Independent samples t-testStatistics↔ compare
  • One-way ANOVAStatistics↔ compare
  • Power analysisStatistics↔ compare
  • ROC analysisStatistics↔ compare
Compare side by side →

Referenced by

Bayesian descriptive statisticsKendall's tauPower analysisRobust Descriptive StatisticsRobust Effect Size AnalysisRobust power analysisROC analysis

Similar methods

Effect SizeEffect Size in Education ResearchPower analysisRobust Effect Size AnalysisStatistical Reporting StandardsStatistical Power and Sample SizePower Analysis for t-testPower Analysis for ANOVA

Related reference concepts

Effect SizeStatistical Power and Sample SizeSample Size CalculationMeta-AnalysisHeterogeneity in Meta-AnalysisHeterogeneity in Meta-Analysis

Spotted an issue on this page? Report or suggest a fix →

ScholarGate — Effect size analysis (Effect Size Analysis). Retrieved 2026-07-21 from https://scholargate.app/en/statistics/effect-size-analysis · Dataset: https://doi.org/10.5281/zenodo.20539026
Quick facts
Originator
Jacob Cohen
Year
1969 (first edition); 1988 (definitive second edition)
Type
Standardized magnitude estimation
DataType
Continuous, categorical, or ranked outcomes
Subfamily
Classical statistics
Related methods
Independent samples t-testOne-way ANOVAPower analysisROC analysis
ScholarGate

A content-first reference library for research methods — what each one is, how it works, and where it comes from.

Open data (CC-BY)

Explore

  • Library
  • Search the library…
  • Browse by field
  • Fields
  • Journey
  • Compare
  • Which method?

Reference

  • Subjects
  • Atlas
  • Glossary
  • Methodology
  • Philosophy

Your tools

  • Bookshelf
  • Desk
  • Chat

Company

  • About
  • Pricing
  • Contact
  • Suggest a method

Entries are compiled from published sources for reference. Verifying the accuracy and suitability of any information for your own use remains your responsibility.

© 2026 ScholarGate · A research-method reference library
  • Privacy
  • Cookies
  • Terms
  • Delete account