ScholarGate
Asystent

Porównaj metody

Przeglądaj wybrane metody obok siebie; wiersze, które się różnią, są wyróżnione.

Dostrojony Transformer×Klasyfikacja oparta na dostrojonym modelu BERT×
DziedzinaUczenie głębokieUczenie głębokie
RodzinaMachine learningMachine learning
Rok powstania2017–20192019
TwórcaVaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI)
TypTransfer learning / supervised fine-tuningPre-trained transformer fine-tuned for classification
Źródło pierwotneVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186. DOI ↗
Inne nazwyTransformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformerBERT fine-tuning, BERT classifier, fine-tuned BERT, BERT sequence classification
Pokrewne45
PodsumowanieFine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.Fine-Tuned BERT-based Classification adapts a pre-trained BERT transformer to a specific text classification task by adding a lightweight output layer and continuing gradient-based training on labelled examples. It consistently achieves near-state-of-the-art accuracy on sentiment analysis, topic categorisation, intent detection, and other NLP classification tasks with relatively small labelled datasets.
ScholarGateZbiór danych
  1. v1
  2. 2 Źródła
  3. PUBLISHED
  1. v1
  2. 2 Źródła
  3. PUBLISHED

Przejdź do wyszukiwania Pobierz slajdy

ScholarGatePorównaj metody: Fine-Tuned Transformer · Fine-Tuned BERT-based Classification. Pobrano 2026-06-18 z https://scholargate.app/pl/compare