手法を比較

	正則化サポートベクターマシン	正則化線形回帰
分野	機械学習	機械学習
系統	Machine learning	Machine learning
提唱年	1995–2004	1970–2005
提唱者	Cortes, C. & Vapnik, V. (soft-margin SVM); Zhu et al. (L1-SVM)	Hoerl & Kennard (Ridge, 1970); Tibshirani (Lasso, 1996); Zou & Hastie (Elastic Net, 2005)
種類	Regularized discriminative classifier / regressor	Penalized linear model
原典	Cortes, C. & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.	Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B, 58(1), 267–288.
別名	Regularized SVM, L1-SVM, L2-SVM, penalized SVM	Ridge regression, Lasso regression, Elastic Net regression, penalized regression
関連	4	4
概要	Regularized Support Vector Machine extends the classic SVM by explicitly controlling the trade-off between margin maximization and training error through an L1 or L2 penalty parameter. The soft-margin formulation introduced by Cortes and Vapnik in 1995 is itself a regularized model, and later L1-SVM variants additionally promote feature sparsity, enabling automatic variable selection in high-dimensional settings.	Regularized linear regression adds a penalty term to the ordinary least-squares objective, shrinking or zeroing out coefficients to reduce overfitting and handle multicollinearity. The three main variants — Ridge (L2 penalty), Lasso (L1 penalty), and Elastic Net (combined L1+L2) — make linear regression usable even when features outnumber observations or predictors are highly correlated.