Linganisha mbinu

	Uulizaji Maswali wa Lugha Nyingi	Uainishaji unaotegemea RoBERTa
Nyanja	Ujifunzaji wa Kina	Ujifunzaji wa Kina
Familia	Machine learning	Machine learning
Mwaka wa asili	2018–2020	2019
Mwanzilishi	Multiple groups; popularised via mBERT (Devlin et al., 2019) and XLM-R (Conneau et al., 2020)	Liu, Y. et al. (Facebook AI Research / University of Washington)
Aina	Extractive / generative QA across multiple languages	Pre-trained transformer fine-tuned for sequence classification
Chanzo asilia	Artetxe, M., Ruder, S., & Yogatama, D. (2020). On the cross-lingual transferability of monolingual representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 4623–4637). ACL.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
Majina mbadala	cross-lingual question answering, multilingual QA, multilingual MRC, cross-lingual machine reading comprehension	RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification
Zinazohusiana	4	5
Muhtasari	Multilingual question answering (QA) enables a model to read a passage and answer questions in multiple languages, often by fine-tuning a cross-lingual pretrained transformer such as mBERT or XLM-R on an annotated QA dataset in one language and transferring that capability zero-shot or few-shot to other languages. It is the standard approach for building multilingual reading-comprehension and open-domain QA systems.	RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks.