方法对比

	半监督梯度提升	自监督学习
领域	机器学习	机器学习
方法族	Machine learning	Machine learning
起源年份	2006–2010s	2018–2020
提出者	Chapelle, Scholkopf & Zien (eds.); applied to GBM variants in subsequent literature	LeCun, Y. and community (formalized ~2018–2020)
类型	Semi-supervised ensemble (self-training + gradient boosted trees)	Representation learning paradigm
开创性文献	Yarowsky, D. (1995). Unsupervised word sense disambiguation rivaling supervised methods. Proceedings of ACL 1995, 189–196. (Foundational self-training framework underlying pseudo-label approaches.)	LeCun, Y. & Misra, I. (2022). Self-supervised learning: The dark matter of intelligence. Meta AI Blog. https://ai.facebook.com/blog/self-supervised-learning-the-dark-matter-of-intelligence/
别名	pseudo-label gradient boosting, self-training GBM, semi-supervised GBT, label-propagation boosting	SSL, self-supervised pre-training, pretext-task learning, unsupervised representation learning
相关	6	3
摘要	Semi-supervised gradient boosting combines gradient boosted trees with self-training or pseudo-labeling to exploit large pools of unlabeled data alongside a small labeled set. An initial GBM fit on labeled data assigns confident predictions to unlabeled examples; those pseudo-labeled points are folded back into training and the model is re-boosted, iterating until convergence. This allows practitioners to harness cheap unlabeled data when labels are scarce or expensive.	Self-supervised learning (SSL) is a machine-learning paradigm that generates its own supervisory signal directly from unlabeled data by defining an auxiliary pretext task — such as predicting masked words, rotating images, or contrasting augmented views — and uses the learned representations as a powerful starting point for downstream tasks with minimal labeled examples.