ScholarGate
المساعد

قارن الطرق

راجع الطرق التي اخترتها جنبًا إلى جنب؛ الصفوف المختلفة مميَّزة.

محوّل مُعدَّل×شبكة عصبية متكررة مضبوطة بدقة×
المجالالتعلم العميقالتعلم العميق
العائلةMachine learningMachine learning
سنة النشأة2017–20192015–2018
صاحب الطريقةVaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015
النوعTransfer learning / supervised fine-tuningTransfer learning / sequential model adaptation
المصدر التأسيسيVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗
الأسماء البديلةTransformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformerFine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation
ذات صلة46
الملخصFine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks.
ScholarGateمجموعة البيانات
  1. v1
  2. 2 المصادر
  3. PUBLISHED
  1. v1
  2. 2 المصادر
  3. PUBLISHED

انتقل إلى البحث تنزيل الشرائح

ScholarGateقارن الطرق: Fine-Tuned Transformer · Fine-Tuned Recurrent Neural Network. استُرجع بتاريخ 2026-06-19 من https://scholargate.app/ar/compare