Methoden vergelijken

	Factoranalyse	K-Nearest Neighbors	Logistische Regressie	Multivariate Analysis of Variance (MANOVA)
Vakgebied	Onderzoeksstatistiek	Machine learning	Onderzoeksstatistiek	Statistiek
Familie	Process / pipeline	Machine learning	Process / pipeline	Hypothesis test
Jaar van ontstaan	1931	1967	1958	1932
Grondlegger	Louis Leon Thurstone	Cover, T.M. & Hart, P.E.	David Roxbee Cox	Samuel Stanley Wilks (Wilks' Lambda, 1932); Roy, Hotelling, Pillai (mid-20th c.)
Type	Method	Instance-based (non-parametric) learning	Method	Parametric multivariate mean comparison
Oorspronkelijke bron	Thurstone, L. L. (1947). Multiple Factor Analysis. University of Chicago Press.	Cover, T.M. & Hart, P.E. (1967). Nearest Neighbor Pattern Classification. IEEE Transactions on Information Theory, 13(1), 21–27.	Cox, D. R. (1958). The regression analysis of binary sequences. Journal of the Royal Statistical Society, Series B, 20(2), 215–242.	Tabachnick, B.G. & Fidell, L.S. (2013). Using Multivariate Statistics (6th ed.). Pearson. ISBN: 978-0205849574
Aliassen	EFA, CFA, latent variable modeling	KNN, K-En Yakın Komşu (KNN), nearest neighbor classifier, instance-based learning	logit model, binomial logistic regression, LR	Multivariate ANOVA, Çok Değişkenli ANOVA (MANOVA)
Verwant	3	5	3	5
Samenvatting	Factor analysis is a statistical technique for identifying latent (unobserved) dimensions underlying observed variables, developed by Louis Leon Thurstone in the 1930s and formalized by Jöreskog (1969). Exploratory factor analysis (EFA) discovers unknown factor structure from data; confirmatory factor analysis (CFA) tests hypothesized relationships between observed and latent variables. Essential in psychometrics (test development), organizational research (measuring constructs like leadership style), and biomedicine (identifying disease subtypes), factor analysis reduces dimensionality while revealing conceptual organization in multivariate data.	K-Nearest Neighbors (KNN), formalized by Cover and Hart in 1967, is a non-parametric, instance-based method that classifies or predicts a new observation by looking at the k closest examples in the training data. For classification it takes a majority vote among those neighbors; for regression it averages their values.	Logistic regression is a statistical method for modeling the probability of a binary outcome (disease present/absent, success/failure) as a function of continuous and categorical predictors. Developed by David Roxbee Cox (1958), it solves the problem of predicting categorical outcomes by applying a logistic transformation to constrain predictions to the [0,1] probability interval, enabling accurate risk stratification, diagnostic prediction, and causal inference in epidemiology, medicine, and social science.	MANOVA is a parametric hypothesis test that simultaneously compares group means across multiple continuous dependent variables, controlling the inflation of Type I error that would result from running separate ANOVAs. Key multivariate test statistics — Wilks' Lambda, Pillai's Trace, Hotelling-Lawley Trace, and Roy's Greatest Root — were developed between the 1930s and 1950s, with Wilks' Lambda formalised by Samuel Stanley Wilks in 1932.