Порівняння методів
Переглядайте обрані методи поруч; рядки з відмінностями підсвічено.
| Доопрацьована рекурентна нейронна мережа× | Довга короткострокова пам'ять (LSTM)× | |
|---|---|---|
| Галузь | Глибоке навчання | Глибоке навчання |
| Родина | Machine learning | Machine learning |
| Рік появи≠ | 2015–2018 | 1997 |
| Автор методу≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Hochreiter, S. & Schmidhuber, J. |
| Тип≠ | Transfer learning / sequential model adaptation | Recurrent neural network with gated memory cells |
| Основоположне джерело≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Hochreiter, S. & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. DOI ↗ |
| Інші назви | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | LSTM, LSTM network, LSTM-RNN, long short-term memory RNN |
| Пов'язані≠ | 6 | 4 |
| Підсумок≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | Long Short-Term Memory (LSTM) is a gated recurrent neural network architecture introduced by Hochreiter and Schmidhuber in 1997. It was designed to learn dependencies across long sequences by using dedicated memory cells and three learned gates — forget, input, and output — that control what information is retained, updated, or passed forward at each time step. |
| ScholarGateНабір даних ↗ |
|
|