Methoden vergleichen

	Multilinguale Fragebeantwortung	RoBERTa-basierte Klassifikation
Fachgebiet	Deep Learning	Deep Learning
Familie	Machine learning	Machine learning
Entstehungsjahr	2018–2020	2019
Urheber	Multiple groups; popularised via mBERT (Devlin et al., 2019) and XLM-R (Conneau et al., 2020)	Liu, Y. et al. (Facebook AI Research / University of Washington)
Typ	Extractive / generative QA across multiple languages	Pre-trained transformer fine-tuned for sequence classification
Wegweisende Quelle	Artetxe, M., Ruder, S., & Yogatama, D. (2020). On the cross-lingual transferability of monolingual representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 4623–4637). ACL.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
Aliasnamen	cross-lingual question answering, multilingual QA, multilingual MRC, cross-lingual machine reading comprehension	RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification
Verwandt	4	5
Zusammenfassung	Multilingual question answering (QA) enables a model to read a passage and answer questions in multiple languages, often by fine-tuning a cross-lingual pretrained transformer such as mBERT or XLM-R on an annotated QA dataset in one language and transferring that capability zero-shot or few-shot to other languages. It is the standard approach for building multilingual reading-comprehension and open-domain QA systems.	RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks.