Machine learning
Gradient Boosting
Gradient Boosting is an ensemble learning method, formalised by Jerome H. Friedman in 2001, that combines a sequence of weak learners — typically shallow decision trees — so that each new tree is fitted to minimise the residual errors of the trees before it. It is the core algorithm behind popular implementations such as XGBoost, LightGBM and CatBoost.
MethodMind'de açSoonVideoSoon
Tam yöntemi oku
Members only
Sign inSign in with a free account to read this section.
Sources
- Friedman, J. H. (2001). Greedy Function Approximation: A Gradient Boosting Machine. Annals of Statistics, 29(5), 1189–1232. DOI: 10.1214/aos/1013203451 ↗
Related methods
Referenced by
Active Learning Gradient BoostingActive Learning LightGBMBaggingBayesian BoostingBayesian LightGBMBayesian XGBoostBoostingBoosting EnsembleConformal Prediction (Time Series)Explainable Extra TreesExplainable Gradient BoostingExplainable LightGBMExplainable Random ForestExplainable Stacking EnsembleExplainable XGBoostExtra TreesLinear Regression (ML)MARSOnline BaggingOnline BoostingOnline Gradient BoostingOnline LightGBMRegularized BoostingRegularized CatBoostRegularized Gradient BoostingRegularized LightGBMRobust BoostingRobust Gradient BoostingRobust LightGBMRobust Random ForestRobust Stacking EnsembleRobust XGBoostSelf-supervised Decision TreeSelf-supervised Gradient BoostingSelf-supervised LightGBMSemi-supervised BaggingSemi-supervised BoostingSemi-supervised CatBoostSemi-supervised Decision TreeSemi-supervised Gradient BoostingSemi-supervised Random ForestSemi-supervised Stacking EnsembleSemi-supervised XGBoostXGBoost