方法对比
并排查看您选择的方法；存在差异的行会高亮显示。
| 微调循环神经网络× | 微调Transformer× | |
|---|---|---|
| 领域 | 深度学习 | 深度学习 |
| 方法族 | Machine learning | Machine learning |
| 起源年份≠ | 2015–2018 | 2017–2019 |
| 提出者≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Vaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al. |
| 类型≠ | Transfer learning / sequential model adaptation | Transfer learning / supervised fine-tuning |
| 开创性文献≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗ |
| 别名 | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | Transformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformer |
| 相关≠ | 6 | 4 |
| 摘要≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | Fine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch. |
| ScholarGate数据集 ↗ |
|
|