Krahasoni metodat
Shqyrtoni metodat e zgjedhura krah për krah; rreshtat që ndryshojnë janë të theksuar.
| Mësimi i Transferueshëm me Njohjen e Entiteteve të Emëruara× | Klasifikim i bazuar në RoBERTa× | |
|---|---|---|
| Fusha | Mësimi i thellë | Mësimi i thellë |
| Familja | Machine learning | Machine learning |
| Viti i origjinës≠ | 2010 / 2019 | 2019 |
| Krijuesi≠ | Pan & Yang (transfer learning); Devlin et al. (BERT-based NER fine-tuning) | Liu, Y. et al. (Facebook AI Research / University of Washington) |
| Lloji≠ | Supervised sequence labeling via pretrained encoder fine-tuning | Pre-trained transformer fine-tuned for sequence classification |
| Burimi themelues≠ | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics. DOI ↗ | Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692. link ↗ |
| Emërtime të tjera | TL-NER, Fine-Tuned NER, Pretrained Model NER, BERT NER | RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification |
| Të lidhura | 5 | 5 |
| Përmbledhja≠ | Transfer Learning with Named Entity Recognition (NER) adapts a large pretrained language model — such as BERT, RoBERTa, or a domain-specific encoder — to the task of identifying and classifying named entities (persons, locations, organizations, dates, etc.) in text. By reusing rich linguistic representations learned from massive corpora, this approach requires only modest labeled NER data while achieving state-of-the-art span detection and classification accuracy. | RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks. |
| ScholarGateSeti i të dhënave ↗ |
|
|