Сравнение на методи

	Полу-наблюдавано обучение на изреченски вграждания	Класификация, базирана на BERT
Област	Дълбоко обучение	Дълбоко обучение
Семейство	Machine learning	Machine learning
Година на възникване	2019–2021	2019
Създател	Gao, T.; Reimers, N. et al. (multiple contributors)	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI Language)
Тип	Semi-supervised representation learning	Pre-trained language model with fine-tuning
Основополагащ източник	Gao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. In Proceedings of EMNLP 2021 (pp. 6894–6910). Association for Computational Linguistics.	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics.
Други названия	Semi-supervised SimCSE, Self-training sentence encoders, Pseudo-labeled sentence representation learning, SSL sentence embeddings	BERT classifier, BERT fine-tuning for classification, BERT text classification, BERT-CLS
Свързани	5	4
Резюме	Semi-supervised sentence embeddings combine a small set of labeled sentence pairs with large quantities of unlabeled text to train dense vector representations of sentences. By exploiting abundant unlabeled data through contrastive objectives or pseudo-labeling, these models produce high-quality embeddings for semantic similarity, retrieval, and classification even when annotated data is scarce.	BERT-based Classification fine-tunes Google's Bidirectional Encoder Representations from Transformers model on a labelled text dataset, replacing the generic pre-trained head with a task-specific classification layer. It exploits deep bidirectional context from hundreds of millions of pre-trained parameters to deliver state-of-the-art accuracy on short- and medium-length text classification tasks with relatively modest amounts of labelled data.