手法を比較

	正則化されたCatBoost	勾配ブースティング
分野	機械学習	機械学習
系統	Machine learning	Machine learning
提唱年	2018	2001
提唱者	Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., & Gulin, A. (Yandex Research)	Friedman, J. H.
種類	Regularized gradient boosting ensemble	Ensemble (sequential boosting of decision trees)
原典	Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., & Gulin, A. (2018). CatBoost: unbiased boosting with categorical features. Advances in Neural Information Processing Systems, 31.	Friedman, J. H. (2001). Greedy Function Approximation: A Gradient Boosting Machine. Annals of Statistics, 29(5), 1189–1232.
別名	CatBoost with regularization, regularized categorical boosting, CatBoost L2 regularization, penalized CatBoost	Gradient Boosting (GBM), GBM, gradient boosted trees, gradient boosting machine
関連	5	5
概要	Regularized CatBoost applies explicit regularization controls — L2 leaf regularization, tree depth constraints, shrinkage rate, and model size penalties — on top of CatBoost's ordered gradient boosting framework, reducing overfitting while retaining CatBoost's native handling of categorical features and its low prediction latency on tabular datasets.	Gradient Boosting is an ensemble learning method, formalised by Jerome H. Friedman in 2001, that combines a sequence of weak learners — typically shallow decision trees — so that each new tree is fitted to minimise the residual errors of the trees before it. It is the core algorithm behind popular implementations such as XGBoost, LightGBM and CatBoost.