手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| 正則化線形回帰× | 線形回帰(機械学習)× | |
|---|---|---|
| 分野 | 機械学習 | 機械学習 |
| 系統 | Machine learning | Machine learning |
| 提唱年≠ | 1970–2005 | 1805–1809 |
| 提唱者≠ | Hoerl & Kennard (Ridge, 1970); Tibshirani (Lasso, 1996); Zou & Hastie (Elastic Net, 2005) | Legendre, A.-M. & Gauss, C.F. |
| 種類≠ | Penalized linear model | Supervised regression |
| 原典≠ | Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B, 58(1), 267–288. DOI ↗ | Hastie, T., Tibshirani, R. & Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd ed., Ch. 3). Springer. ISBN: 978-0-387-84858-7 |
| 別名 | Ridge regression, Lasso regression, Elastic Net regression, penalized regression | ordinary least squares regression, OLS, least squares regression, multiple linear regression |
| 関連≠ | 4 | 5 |
| 概要≠ | Regularized linear regression adds a penalty term to the ordinary least-squares objective, shrinking or zeroing out coefficients to reduce overfitting and handle multicollinearity. The three main variants — Ridge (L2 penalty), Lasso (L1 penalty), and Elastic Net (combined L1+L2) — make linear regression usable even when features outnumber observations or predictors are highly correlated. | Linear regression fits a straight-line relationship between one or more input features and a continuous numeric outcome by minimising the sum of squared prediction errors. As a machine-learning model it is trained on labeled examples and evaluated on held-out data, making it the simplest supervised learning baseline for any regression task. |
| ScholarGateデータセット ↗ |
|
|