Сравнение на методи
Прегледайте избраните методи един до друг; редовете с разлики са откроени.
| Фино настроена рекурентна невронна мрежа× | Вентилна рекурентна единица (GRU)× | |
|---|---|---|
| Област | Дълбоко обучение | Дълбоко обучение |
| Семейство | Machine learning | Machine learning |
| Година на възникване≠ | 2015–2018 | 2014 |
| Създател≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. |
| Тип≠ | Transfer learning / sequential model adaptation | Recurrent neural network with gating |
| Основополагащ източник≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In Proceedings of EMNLP 2014, pp. 1724–1734. link ↗ |
| Други названия | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | GRU, GRU network, gated RNN, GRU cell |
| Свързани≠ | 6 | 3 |
| Резюме≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | The Gated Recurrent Unit (GRU), introduced by Cho et al. in 2014, is a streamlined recurrent neural network that uses two learned gates — an update gate and a reset gate — to selectively retain or discard information across time steps, enabling effective sequence modelling with fewer parameters than LSTM. |
| ScholarGateНабор от данни ↗ |
|
|