Сравнение методов

	Многоязычная классификация на основе RoBERTa	Мультиязычный трансформер
Область	Глубокое обучение	Глубокое обучение
Семейство	Machine learning	Machine learning
Год появления	2020	2019–2020
Автор метода	Conneau, A. et al. (Facebook AI Research)	Devlin et al. (mBERT); Conneau et al. (XLM-R)
Тип	Pretrained multilingual transformer fine-tuned for classification	Pre-trained cross-lingual language model
Основополагающий источник	Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzman, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020). Unsupervised Cross-lingual Representation Learning at Scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), pp. 8440–8451.	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, pp. 4171–4186. Association for Computational Linguistics.
Другие названия	XLM-RoBERTa classification, mRoBERTa, cross-lingual RoBERTa classifier, multilingual transformer classification	multilingual LM, cross-lingual transformer, mBERT-style model, multilingual pre-trained model
Связанные	4	4
Сводка	Multilingual RoBERTa-based classification uses XLM-RoBERTa — a transformer pretrained on 100+ languages via masked language modeling — and fine-tunes it on labeled text to assign categories across multiple languages. By sharing a single model across languages, it enables robust cross-lingual and zero-shot text classification without needing separate per-language classifiers.	A multilingual transformer is a pre-trained language model built on the transformer architecture and trained jointly on text from dozens to over one hundred languages. Models such as mBERT and XLM-RoBERTa learn shared cross-lingual representations, enabling zero-shot or few-shot transfer: a model fine-tuned on English data can often be applied directly to French, German, Arabic, or Chinese without language-specific labels.