Порівняння методів
Переглядайте обрані методи поруч; рядки з відмінностями підсвічено.
| Доопрацьована рекурентна нейронна мережа× | Рекурентна нейронна мережа× | |
|---|---|---|
| Галузь | Глибоке навчання | Глибоке навчання |
| Родина | Machine learning | Machine learning |
| Рік появи≠ | 2015–2018 | 1986–1990 |
| Автор методу≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Rumelhart, D. E.; Elman, J. L. |
| Тип≠ | Transfer learning / sequential model adaptation | Sequential neural network |
| Основоположне джерело≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179–211. DOI ↗ |
| Інші назви | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | RNN, Elman network, Jordan network, simple recurrent network |
| Пов'язані≠ | 6 | 3 |
| Підсумок≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | A Recurrent Neural Network (RNN) is a class of neural network designed to process sequential data by maintaining a hidden state that carries information across time steps. Introduced in its modern form by Rumelhart et al. (1986) and further shaped by Elman (1990), RNNs became the dominant architecture for sequence modelling in NLP, speech, and time-series analysis before the rise of attention-based models. |
| ScholarGateНабір даних ↗ |
|
|