方法对比

	多语言问答	基于RoBERTa的分类
领域	深度学习	深度学习
方法族	Machine learning	Machine learning
起源年份	2018–2020	2019
提出者	Multiple groups; popularised via mBERT (Devlin et al., 2019) and XLM-R (Conneau et al., 2020)	Liu, Y. et al. (Facebook AI Research / University of Washington)
类型	Extractive / generative QA across multiple languages	Pre-trained transformer fine-tuned for sequence classification
开创性文献	Artetxe, M., Ruder, S., & Yogatama, D. (2020). On the cross-lingual transferability of monolingual representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 4623–4637). ACL.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
别名	cross-lingual question answering, multilingual QA, multilingual MRC, cross-lingual machine reading comprehension	RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification
相关	4	5
摘要	Multilingual question answering (QA) enables a model to read a passage and answer questions in multiple languages, often by fine-tuning a cross-lingual pretrained transformer such as mBERT or XLM-R on an annotated QA dataset in one language and transferring that capability zero-shot or few-shot to other languages. It is the standard approach for building multilingual reading-comprehension and open-domain QA systems.	RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks.