手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| 正則化k近傍法× | 正則化サポートベクターマシン× | |
|---|---|---|
| 分野 | 機械学習 | 機械学習 |
| 系統 | Machine learning | Machine learning |
| 提唱年≠ | 1967–2000s | 1995–2004 |
| 提唱者≠ | Extends Cover & Hart (1967); regularization formulations developed through kernel smoothing literature | Cortes, C. & Vapnik, V. (soft-margin SVM); Zhu et al. (L1-SVM) |
| 種類≠ | Instance-based / lazy learner with regularization | Regularized discriminative classifier / regressor |
| 原典≠ | Cover, T. & Hart, P. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13(1), 21–27. DOI ↗ | Cortes, C. & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. DOI ↗ |
| 別名 | regularized kNN, kernel-weighted kNN, distance-regularized nearest neighbors, kNN with regularization | Regularized SVM, L1-SVM, L2-SVM, penalized SVM |
| 関連 | 4 | 4 |
| 概要≠ | Regularized k-Nearest Neighbors (kNN) extends the classical nearest-neighbor algorithm by incorporating regularization mechanisms — most commonly kernel-based distance weighting or bandwidth control — that smooth predictions, reduce sensitivity to the choice of k, and lower variance. The result is a more stable and better-calibrated instance-based learner for classification and regression tasks on tabular data. | Regularized Support Vector Machine extends the classic SVM by explicitly controlling the trade-off between margin maximization and training error through an L1 or L2 penalty parameter. The soft-margin formulation introduced by Cortes and Vapnik in 1995 is itself a regularized model, and later L1-SVM variants additionally promote feature sparsity, enabling automatic variable selection in high-dimensional settings. |
| ScholarGateデータセット ↗ |
|
|