ScholarGate
Asistenti

Krahasoni metodat

Shqyrtoni metodat e zgjedhura krah për krah; rreshtat që ndryshojnë janë të theksuar.

Rrjeti i Tretur i Rregulluar me Përsosje (Fine-Tuned Recurrent Neural Network)×Transformues i akorduar imët×
FushaMësimi i thellëMësimi i thellë
FamiljaMachine learningMachine learning
Viti i origjinës2015–20182017–2019
KrijuesiPopularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015Vaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.
LlojiTransfer learning / sequential model adaptationTransfer learning / supervised fine-tuning
Burimi themeluesHoward, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗
Emërtime të tjeraFine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptationTransformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformer
Të lidhura64
PërmbledhjaA Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks.Fine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.
ScholarGateSeti i të dhënave
  1. v1
  2. 2 Burimet
  3. PUBLISHED
  1. v1
  2. 2 Burimet
  3. PUBLISHED

Shko te kërkimi Shkarko diapozitivat

ScholarGateKrahasoni metodat: Fine-Tuned Recurrent Neural Network · Fine-Tuned Transformer. Marrë më 2026-06-19 nga https://scholargate.app/sq/compare