Nonparametric Statistical Tests
Distribution-Free Hypothesis Testing · Also known as: rank-based tests, Mann-Whitney U, Kruskal-Wallis, distribution-free
Nonparametric (distribution-free) tests are statistical methods for hypothesis testing that do not assume data follow a specific probability distribution (e.g., normal), making them robust to departures from normality, outliers, and ordinal data. The Mann-Whitney U test (1947) and Kruskal-Wallis test (1952) extend hypothesis testing beyond the constraints of parametric assumptions. Essential in biology, medicine, psychology, and any field where data are non-normal, highly skewed, or measured on ordinal scales (rankings, ratings), nonparametric tests provide valid inference when parametric assumptions fail.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use nonparametric tests when parametric test assumptions are violated and transformation (log, square-root) cannot normalize data, or when data are inherently ordinal. Psychology: analyzing Likert scale responses (ordinal, often non-normal); many studies use scales with < 10 categories where normality implausible. Medicine: comparing biomarker values across treatment groups when measurements are highly skewed (e.g., some patients with zero values, others with high values). Biology: assessing rank-based measures (species abundance rankings, tournament rankings). Also use nonparametric methods as default in early exploratory analysis when data distribution unknown; if results align with parametric tests, parametric approach likely safe for confirmatory analysis.
Strengths & limitations
- Robust to non-normality and outliers: valid p-values even when data are severely non-normal or contain extreme values that cannot be removed.
- Works with ordinal data: can analyze Likert scales, rankings, or other ordered categories; parametric tests assume continuous data, making them technically invalid for ordinal.
- Simple computation: rank-based statistics are intuitive and computationally simple; can be calculated by hand for small samples.
- Distribution-free: do not assume any specific probability distribution, making them universally applicable to diverse data types.
- Good statistical power under violation of parametric assumptions: when parametric assumptions are false, nonparametric tests are more powerful than parametric tests that produce invalid p-values.
- Loss of power under ideal conditions: when data are truly normally distributed with equal variances, nonparametric tests lose 5–15% power compared to t-tests (asymptotic relative efficiency ~0.95).
- Less developed for complex designs: fewer nonparametric equivalents exist for factorial ANOVA, MANOVA, or complex covariate adjustment; multilevel nonparametric methods less standard.
- Effect size less standardized: unlike parametric tests with well-established effect size measures (Cohen's d), nonparametric effect sizes (r, rank-biserial correlation) are less common in practice.
- Post-hoc testing complex: pairwise comparisons after Kruskal-Wallis less standardized; multiple testing correction penalties may reduce power.
- Restricted to tests of location or association: nonparametric methods primarily test whether distributions differ; cannot estimate parameters or test specific hypotheses about mean structure.
Frequently asked
When should I use Mann-Whitney U instead of an independent t-test?
Use Mann-Whitney U if: (1) data are not normally distributed (Q-Q plot shows departure, Shapiro-Wilk p < 0.05), (2) variances are unequal (Levene's test p < 0.05) and sample sizes unequal, (3) data are ordinal (rankings, ratings), (4) sample sizes are small (n < 30) so normality cannot be verified, or (5) outliers are present that are real (not measurement error) and cannot be removed. If data are clearly normal and equal-variance, t-test is preferred (more powerful). In practice, Mann-Whitney U is conservative choice; it works reasonably well even for normal data (power loss ~5%), so using it liberally is defensible.
What does the Mann-Whitney U test actually test—medians or distributions?
Technically, Mann-Whitney U tests if distributions differ (stochastic dominance). If distributions have the same shape, the test approximates a test of median difference. However, two distributions can have equal medians but different shapes (e.g., one symmetric, one skewed). Conversely, different medians imply different distributions. Best practice: always visualize both distributions with box plots or density plots; examining the actual data clarifies whether the test result reflects median difference or broader distributional difference. Report both p-value and median difference for practical interpretation.
How do I handle tied ranks in nonparametric tests?
Ties (equal values) are assigned the average rank. For example, if two observations tie for 5th place, both are assigned rank 5.5. This is the standard approach and is what statistical software implements. With many ties, the test statistic may need adjustment (mid-rank tests, permutation tests). If ties are very common (e.g., many zero values or heavily categorized data), consider alternatives: permutation tests, or robust methods designed for discrete data.
Can I use nonparametric tests with Likert scale data?
Yes, nonparametric tests are well-suited for Likert scales (ordinal data). Mann-Whitney U compares distributions of Likert responses between groups; Kruskal-Wallis compares three or more groups. However, be cautious with scales with very few categories (e.g., 3-point scale): test power is reduced compared to continuous data. Alternatively, for multi-item Likert scales (e.g., summing multiple items into a composite score), the composite may approximate normality (Central Limit Theorem), justifying parametric tests. Use nonparametric tests as a safe default for single-item ordinal measures.
Sources
- Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18(1), 50–60. DOI: 10.1214/aoms/1177730491 ↗
- Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, 47(260), 583–621. DOI: 10.1080/01621459.1952.10483441 ↗
- Conover, W. J. (1999). Practical Nonparametric Statistics (3rd ed.). John Wiley & Sons. link ↗
How to cite this page
ScholarGate. (2026, June 4). Distribution-Free Hypothesis Testing. ScholarGate. https://scholargate.app/en/research-statistics/nonparametric-tests
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Analysis of Variance (ANOVA)Research Statistics↔ compare
- Bayesian Statistical InferenceResearch Statistics↔ compare
- Multiple Regression AnalysisResearch Statistics↔ compare