Methoden vergleichen

	Selbstüberwachtes Transferlernen	Few-Shot Learning
Fachgebiet	Maschinelles Lernen	Maschinelles Lernen
Familie	Machine learning	Machine learning
Entstehungsjahr	2018–2020 (modern consolidation)	2011–2017
Urheber	LeCun, Y. (concept); Devlin et al. (BERT, NLP); Chen et al. (SimCLR, vision)	Lake, B. M.; Vinyals, O.; Finn, C. et al.
Typ	Learning paradigm (self-supervised pre-training + fine-tuning)	Meta-learning / low-data learning paradigm
Wegweisende Quelle	Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning (ICML), PMLR 119, 1597–1607.	Vinyals, O., Blundell, C., Lillicrap, T., Wierstra, D., & Kavukcuoglu, K. (2016). Matching Networks for One Shot Learning. Advances in Neural Information Processing Systems (NeurIPS), 29.
Aliasnamen	self-supervised pre-training, SSL-based transfer learning, representation transfer from self-supervised models, contrastive pre-training with transfer	FSL, low-shot learning, k-shot learning, meta-learning for few examples
Verwandt	6	4
Zusammenfassung	Self-supervised transfer learning combines two powerful paradigms: a model first learns rich representations from unlabeled data using self-supervised pretext tasks, then those learned representations are transferred and fine-tuned on a downstream task with limited labeled data. This approach underlies landmark systems such as BERT in NLP and SimCLR and DINO in computer vision, dramatically reducing labeled-data requirements across many domains.	Few-shot learning is a machine learning paradigm that trains models to recognize new classes or solve new tasks from only a handful of labeled examples — typically one to five — by leveraging prior knowledge acquired from a large, related training distribution. It is especially relevant in domains where labeling is expensive, scarce, or structurally limited.