Порівняння методів
Переглядайте обрані методи поруч; рядки з відмінностями підсвічено.
| Доопрацьована рекурентна нейронна мережа× | Fine-Tuned LSTM× | |
|---|---|---|
| Галузь | Глибоке навчання | Глибоке навчання |
| Родина | Machine learning | Machine learning |
| Рік появи≠ | 2015–2018 | 2018 (fine-tuning paradigm formalised); LSTM core: 1997 |
| Автор методу≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Howard, J. & Ruder, S. (ULMFiT); foundational LSTM by Hochreiter & Schmidhuber |
| Тип≠ | Transfer learning / sequential model adaptation | Supervised sequential model with transfer learning |
| Основоположне джерело≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Howard, J., & Ruder, S. (2018). Universal Language Model Fine-tuning for Text Classification. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL), 328–339. DOI ↗ |
| Інші назви | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | Fine-Tuned LSTM, LSTM Fine-Tuning, Pre-trained LSTM with Task Adaptation, LSTM Transfer Learning |
| Пов'язані | 6 | 6 |
| Підсумок≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | Fine-Tuned LSTM adapts a Long Short-Term Memory network pre-trained on a large corpus to a specific downstream task — such as text classification, sentiment analysis, or sequence labeling — by continuing training on task-specific labeled data. Popularised by the ULMFiT framework, this approach achieves strong performance even when labeled data is scarce. |
| ScholarGateНабір даних ↗ |
|
|