手法を比較

	影響診断（Cook距離、DFFITS、レバレッジ）	最小二乗法 (OLS) 回帰	リッジ回帰
分野	統計学	計量経済学	機械学習
系統	Regression model	Regression model	Machine learning
提唱年	1977	2019	1970
提唱者	R. Dennis Cook (Cook's distance); Belsley, Kuh & Welsch (DFFITS, leverage)	Wooldridge (textbook treatment); classical least squares	Hoerl, A.E. & Kennard, R.W.
種類	Regression diagnostic	Linear regression	L2-regularized linear regression
原典	Cook, R. D. (1977). Detection of Influential Observations in Linear Regression. Technometrics, 19(1), 15-18.	Wooldridge, J. M. (2019). Introductory Econometrics: A Modern Approach (7th ed.). Cengage Learning. ISBN: 978-1337558860	Hoerl, A.E. & Kennard, R.W. (1970). Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12(1), 55–67.
別名	Cook's distance, DFFITS, leverage, influential observation detection	ordinary least squares, classical linear regression, linear regression, en küçük kareler regresyonu	Ridge Regresyonu, ridge regresyonu, L2-regularized regression, Tikhonov regularization
関連	5	5	4
概要	Influence diagnostics are a family of post-fit measures that quantify how much each single observation affects a fitted regression. Cook's distance was introduced by R. Dennis Cook in 1977, with leverage and DFFITS formalised by Belsley, Kuh and Welsch in 1980, to flag the observations that most strongly pull the estimated coefficients.	Ordinary Least Squares is the classical linear regression method that explains a continuous outcome as a linear combination of predictors. It estimates the coefficients by minimising the sum of squared residuals, and under the Gauss-Markov assumptions these estimates are the best linear unbiased estimator (BLUE).	Ridge Regression is an L2-regularized linear regression method, introduced by Arthur Hoerl and Robert Kennard in 1970, that reduces multicollinearity by adding a penalty on the size of the coefficients. It shrinks coefficients toward zero without setting any of them exactly to zero, producing more stable estimates when predictors are highly correlated.