Порівняння методів
Переглядайте обрані методи поруч; рядки з відмінностями підсвічено.
| Багатомовна відповідь на запитання× | Класифікація на основі BERT× | |
|---|---|---|
| Галузь | Глибоке навчання | Глибоке навчання |
| Родина | Machine learning | Machine learning |
| Рік появи≠ | 2018–2020 | 2019 |
| Автор методу≠ | Multiple groups; popularised via mBERT (Devlin et al., 2019) and XLM-R (Conneau et al., 2020) | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI Language) |
| Тип≠ | Extractive / generative QA across multiple languages | Pre-trained language model with fine-tuning |
| Основоположне джерело≠ | Artetxe, M., Ruder, S., & Yogatama, D. (2020). On the cross-lingual transferability of monolingual representations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 4623–4637). ACL. DOI ↗ | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics. DOI ↗ |
| Інші назви | cross-lingual question answering, multilingual QA, multilingual MRC, cross-lingual machine reading comprehension | BERT classifier, BERT fine-tuning for classification, BERT text classification, BERT-CLS |
| Пов'язані | 4 | 4 |
| Підсумок≠ | Multilingual question answering (QA) enables a model to read a passage and answer questions in multiple languages, often by fine-tuning a cross-lingual pretrained transformer such as mBERT or XLM-R on an annotated QA dataset in one language and transferring that capability zero-shot or few-shot to other languages. It is the standard approach for building multilingual reading-comprehension and open-domain QA systems. | BERT-based Classification fine-tunes Google's Bidirectional Encoder Representations from Transformers model on a labelled text dataset, replacing the generic pre-trained head with a task-specific classification layer. It exploits deep bidirectional context from hundreds of millions of pre-trained parameters to deliver state-of-the-art accuracy on short- and medium-length text classification tasks with relatively modest amounts of labelled data. |
| ScholarGateНабір даних ↗ |
|
|