Porovnať metódy
Prezrite si vybrané metódy vedľa seba; riadky, ktoré sa líšia, sú zvýraznené.
| Viacjazyčný Doc2Vec× | Viacjazyčný Transformer× | |
|---|---|---|
| Odbor | Hlboké učenie | Hlboké učenie |
| Rodina | Machine learning | Machine learning |
| Rok vzniku≠ | 2014–2016 | 2019–2020 |
| Tvorca≠ | Le, Q. & Mikolov, T. (Doc2Vec); multilingual extension by community | Devlin et al. (mBERT); Conneau et al. (XLM-R) |
| Typ≠ | Distributed document embedding (unsupervised / self-supervised) | Pre-trained cross-lingual language model |
| Pôvodný zdroj≠ | Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning (ICML), PMLR 32(2), 1188–1196. link ↗ | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, pp. 4171–4186. Association for Computational Linguistics. DOI ↗ |
| Ďalšie názvy | multilingual paragraph vector, cross-lingual Doc2Vec, multilingual PV-DM, multilingual PV-DBOW | multilingual LM, cross-lingual transformer, mBERT-style model, multilingual pre-trained model |
| Príbuzné | 4 | 4 |
| Zhrnutie≠ | Multilingual Doc2Vec extends the Paragraph Vector framework of Le and Mikolov (2014) to two or more languages, training document-level embeddings in a shared or aligned vector space so that semantically similar documents — regardless of their language — end up close together. It enables cross-lingual document retrieval, classification, and clustering without requiring parallel corpora or translation. | A multilingual transformer is a pre-trained language model built on the transformer architecture and trained jointly on text from dozens to over one hundred languages. Models such as mBERT and XLM-RoBERTa learn shared cross-lingual representations, enabling zero-shot or few-shot transfer: a model fine-tuned on English data can often be applied directly to French, German, Arabic, or Chinese without language-specific labels. |
| ScholarGateDátová sada ↗ |
|
|