手法を比較

	決定木	一般化加法モデル（GAM）	回帰スプラインと平滑化スプライン
分野	機械学習	機械学習	機械学習
系統	Machine learning	Machine learning	Machine learning
提唱年	1984	1986	1996
提唱者	Breiman, Friedman, Olshen & Stone	Trevor Hastie & Robert Tibshirani	Spline regression literature; P-splines by Eilers & Marx
種類	Recursive partitioning (if-then rules)	Semi-parametric additive regression model	Piecewise-polynomial nonparametric regression
原典	Breiman, L., Friedman, J.H., Olshen, R.A. & Stone, C.J. (1984). Classification and Regression Trees. Wadsworth.	Hastie, T., & Tibshirani, R. (1986). Generalized additive models. Statistical Science, 1(3), 297–310.	Eilers, P. H. C., & Marx, B. D. (1996). Flexible smoothing with B-splines and penalties. Statistical Science, 11(2), 89–121.
別名	Karar Ağacı (Decision Tree), karar ağacı, classification tree, regression tree	GAM, additive model, spline-based additive regression, Genelleştirilmiş toplamsal model	splines, cubic splines, natural splines, smoothing splines
関連	5	4	4
概要	A Decision Tree is an interpretable classification and regression method, formalised by Breiman, Friedman, Olshen and Stone in their 1984 CART framework, that partitions the data with hierarchical if-then rules. Each split sends observations down one branch or another until a prediction is read off the leaf.	A generalized additive model, introduced by Trevor Hastie and Robert Tibshirani in 1986, extends the generalized linear model by replacing each linear term with a smooth, data-driven function of the predictor. This lets the model capture nonlinear relationships while preserving the additive, term-by-term interpretability of regression: each predictor contributes its own estimated curve, and the curves simply add up (on a link scale) to predict the response.	Regression splines model a nonlinear relationship by fitting piecewise polynomials that join smoothly at a set of points called knots. Cubic and natural splines are the most common, and smoothing splines add a roughness penalty that automatically balances fit against smoothness. Splines are the standard flexible building block for univariate nonlinear regression and the basis of generalized additive models.