Linganisha mbinu

	Uainishaji wa RoBERTa unaojirekebisha Kikoa	Uainishaji wa RoBERTa Uliosawazishwa Vizuri
Nyanja	Ujifunzaji wa Kina	Ujifunzaji wa Kina
Familia	Machine learning	Machine learning
Mwaka wa asili	2019–2020	2019
Mwanzilishi	Liu et al. (RoBERTa); Gururangan et al. (domain-adaptive pretraining)	Liu, Y. et al. (Meta AI / University of Washington)
Aina	Pre-trained transformer with domain-adaptive pretraining and task fine-tuning	Pretrained transformer fine-tuned for classification
Chanzo asilia	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692.
Majina mbadala	DA-RoBERTa, domain-adapted RoBERTa classifier, RoBERTa domain adaptation, domain-specific RoBERTa fine-tuning	RoBERTa fine-tuning, RoBERTa classifier, fine-tuned RoBERTa, RoBERTa sequence classification
Zinazohusiana	5	5
Muhtasari	Domain-adaptive RoBERTa-based classification extends the RoBERTa transformer by first continuing its masked-language-model pretraining on a domain-specific corpus before fine-tuning for a classification task. This two-stage adaptation bridges the gap between general web-crawled training data and specialized fields such as biomedical, legal, or scientific text, consistently outperforming standard RoBERTa fine-tuning when target-domain text is available.	Fine-tuned RoBERTa-based classification adapts the RoBERTa pretrained transformer — itself a robustly retrained variant of BERT — to a specific text classification task by appending a classification head and continuing training on labeled examples. It consistently achieves state-of-the-art or near-state-of-the-art performance on sentiment analysis, topic classification, toxicity detection, and similar NLP tasks.