ScholarGate
Asistent
Machine learningDeep learning / NLP / CV

Višejezični transformator

Višejezični transformator je pred-obučen jezični model izgrađen na arhitekturi transformatora i zajednički obučen na tekstu iz desetaka do preko stotinu jezika. Modeli poput mBERT-a i XLM-RoBERTa-e uče zajedničke unakrsne jezične reprezentacije, omogućujući prijenos bez primjera (zero-shot) ili s malo primjera (few-shot): model fino-podešen na engleskim podacima često se može izravno primijeniti na francuski, njemački, arapski ili kineski bez jezično-specifičnih oznaka.

Otvorite u MethodMindUskoroVideoUskoroDownload slides

Pročitajte cijelu metodu

Samo za članove

Prijavite se besplatnim računom kako biste pročitali ovaj odjeljak.

Prijavite se

Method map

The neighbourhood of related methods — select a node to explore.

+10 more

Izvori

  1. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, pp. 4171–4186. Association for Computational Linguistics. DOI: 10.18653/v1/N19-1423
  2. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of ACL 2020, pp. 8440–8451. Association for Computational Linguistics. DOI: 10.18653/v1/2020.acl-main.747

Kako citirati ovu stranicu

ScholarGate. (2026, June 3). Multilingual Transformer (Cross-lingual Pre-trained Language Model). ScholarGate. https://scholargate.app/hr/deep-learning/multilingual-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side

Citirana u

ScholarGateMultilingual Transformer (Multilingual Transformer (Cross-lingual Pre-trained Language Model)). Preuzeto 2026-06-15 s https://scholargate.app/hr/deep-learning/multilingual-transformer · Skup podataka: https://doi.org/10.5281/zenodo.20539026