Methoden vergleichen

	Problem der multiplen Vergleiche	Nullhypothesentestung
Fachgebiet	Forschungsstatistik	Forschungsstatistik
Familie	Process / pipeline	Process / pipeline
Entstehungsjahr	1935	1925
Urheber	Carlo Bonferroni; Benjamini & Hochberg	Ronald Fisher; Neyman & Pearson
Typ	Concept	Concept
Wegweisende Quelle	Bonferroni, C. E. (1935). Il calcolo dei coefficienti di correlazione nel caso di variabilità di gruppi. Instituto Italiano di Statistica.	Fisher, R. A. (1925). Statistical Methods for Research Workers. Oliver and Boyd.
Aliasnamen	multiple testing, family-wise error, p-value adjustment, false discovery rate	NHST, hypothesis formulation, null hypothesis, alternative hypothesis
Verwandt	4	4
Zusammenfassung	When conducting multiple statistical tests, the probability of obtaining at least one false positive by chance increases with the number of tests. The multiple comparisons problem (also called the multiplicity problem) occurs because if you conduct 100 hypothesis tests at α = 0.05, you expect ~5 false positives by chance alone, even if all null hypotheses are true. Correction methods—Bonferroni, Benjamini-Hochberg false discovery rate (FDR), and others—adjust the significance threshold or p-values to control error rates. This concept is critical for research integrity and has profound implications for exploratory science.	Null Hypothesis Significance Testing (NHST) is the dominant statistical framework in empirical research. The null hypothesis (H₀) represents the default assumption—typically 'no effect' or 'no difference'—while the alternative hypothesis (H₁) represents the claim being tested. The test calculates the probability of observing the data given H₀ is true (p-value); if p is very small, H₀ is rejected in favor of H₁. Formulated by Ronald Fisher and extended by Neyman and Pearson in the early 20th century, NHST is foundational to confirmatory research but has been widely critiqued for misuse and misinterpretation.