Salīdzināt metodes

	Pusuzraudzīta klasifikācija, izmantojot RoBERTa	Klasifikācija, kas balstīta uz RoBERTa
Nozare	Dziļā mācīšanās	Dziļā mācīšanās
Saime	Machine learning	Machine learning
Izcelsmes gads	2019–2020	2019
Autors	Liu et al. (RoBERTa, 2019); semi-supervised adaptation by the NLP community	Liu, Y. et al. (Facebook AI Research / University of Washington)
Tips	Semi-supervised fine-tuning of a pretrained language model	Pre-trained transformer fine-tuned for sequence classification
Pirmavots	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
Citi nosaukumi	Semi-supervised RoBERTa, RoBERTa with semi-supervised learning, SSL-RoBERTa classification, RoBERTa pseudo-label classification	RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification
Saistītās	6	5
Kopsavilkums	Semi-supervised RoBERTa-based classification combines a large pretrained RoBERTa language model with both a small labeled dataset and a larger pool of unlabeled text. By generating pseudo-labels or enforcing consistency on unlabeled examples, the method extracts supervisory signal from unannotated data, yielding stronger classifiers when ground-truth annotations are scarce.	RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks.