Krahasoni metodat
Shqyrtoni metodat e zgjedhura krah për krah; rreshtat që ndryshojnë janë të theksuar.
| Regresioni Lasso× | Regresioni me Mënyrën më të Vogël të Katrorëve (OLS)× | Regresioni Ridge× | |
|---|---|---|---|
| Fusha≠ | Mësimi i makinës | Ekonometri | Mësimi i makinës |
| Familja≠ | Machine learning | Regression model | Machine learning |
| Viti i origjinës≠ | 1996 | 2019 | 1970 |
| Krijuesi≠ | Tibshirani, R. | Wooldridge (textbook treatment); classical least squares | Hoerl, A.E. & Kennard, R.W. |
| Lloji≠ | Regularized linear regression (L1 penalty) | Linear regression | L2-regularized linear regression |
| Burimi themelues≠ | Tibshirani, R. (1996). Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B, 58(1), 267–288. DOI ↗ | Wooldridge, J. M. (2019). Introductory Econometrics: A Modern Approach (7th ed.). Cengage Learning. ISBN: 978-1337558860 | Hoerl, A.E. & Kennard, R.W. (1970). Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12(1), 55–67. DOI ↗ |
| Emërtime të tjera | LASSO Regresyonu, lasso, L1-regularized regression, L1 regularization | ordinary least squares, classical linear regression, linear regression, en küçük kareler regresyonu | Ridge Regresyonu, ridge regresyonu, L2-regularized regression, Tikhonov regularization |
| Të lidhura≠ | 4 | 5 | 4 |
| Përmbledhja≠ | Lasso regression, introduced by Robert Tibshirani in 1996, is a linear regression method that adds an L1 penalty to the loss so that it shrinks coefficients and performs variable selection at the same time, producing a sparse model. By driving some coefficients exactly to zero it keeps only the predictors that matter. | Ordinary Least Squares is the classical linear regression method that explains a continuous outcome as a linear combination of predictors. It estimates the coefficients by minimising the sum of squared residuals, and under the Gauss-Markov assumptions these estimates are the best linear unbiased estimator (BLUE). | Ridge Regression is an L2-regularized linear regression method, introduced by Arthur Hoerl and Robert Kennard in 1970, that reduces multicollinearity by adding a penalty on the size of the coefficients. It shrinks coefficients toward zero without setting any of them exactly to zero, producing more stable estimates when predictors are highly correlated. |
| ScholarGateSeti i të dhënave ↗ |
|
|
|