So sánh phương pháp

	Transformer đa ngôn ngữ	Nhúng câu (Sentence Embeddings)
Lĩnh vực	Học sâu	Học sâu
Họ	Machine learning	Machine learning
Năm ra đời	2019–2020	2015–2019
Người khởi xướng	Devlin et al. (mBERT); Conneau et al. (XLM-R)	Kiros et al. (Skip-Thought, 2015); Reimers & Gurevych (Sentence-BERT, 2019)
Loại	Pre-trained cross-lingual language model	Representation learning / embedding
Công trình gốc	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, pp. 4171–4186. Association for Computational Linguistics.	Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3980–3990.
Tên gọi khác	multilingual LM, cross-lingual transformer, mBERT-style model, multilingual pre-trained model	sentence vectors, sentence representations, SBERT, semantic sentence encoding
Liên quan	4	4
Tóm tắt	A multilingual transformer is a pre-trained language model built on the transformer architecture and trained jointly on text from dozens to over one hundred languages. Models such as mBERT and XLM-RoBERTa learn shared cross-lingual representations, enabling zero-shot or few-shot transfer: a model fine-tuned on English data can often be applied directly to French, German, Arabic, or Chinese without language-specific labels.	Sentence Embeddings convert a sentence or short text into a single fixed-length dense vector that captures its semantic meaning. These vectors allow downstream tasks — semantic similarity, clustering, retrieval, and classification — to operate on numerical representations instead of raw text, making them one of the most versatile building blocks in modern NLP pipelines.