Porovnat metody
Prohlédněte si vybrané metody vedle sebe; řádky, které se liší, jsou zvýrazněny.
| Dolaďovaná rekurentní neuronová síť× | Jemně doladěné LSTM× | |
|---|---|---|
| Obor | Hluboké učení | Hluboké učení |
| Rodina | Machine learning | Machine learning |
| Rok vzniku≠ | 2015–2018 | 2018 (fine-tuning paradigm formalised); LSTM core: 1997 |
| Tvůrce≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Howard, J. & Ruder, S. (ULMFiT); foundational LSTM by Hochreiter & Schmidhuber |
| Typ≠ | Transfer learning / sequential model adaptation | Supervised sequential model with transfer learning |
| Původní zdroj≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Howard, J., & Ruder, S. (2018). Universal Language Model Fine-tuning for Text Classification. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL), 328–339. DOI ↗ |
| Další názvy | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | Fine-Tuned LSTM, LSTM Fine-Tuning, Pre-trained LSTM with Task Adaptation, LSTM Transfer Learning |
| Příbuzné | 6 | 6 |
| Shrnutí≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | Fine-Tuned LSTM adapts a Long Short-Term Memory network pre-trained on a large corpus to a specific downstream task — such as text classification, sentiment analysis, or sequence labeling — by continuing training on task-specific labeled data. Popularised by the ULMFiT framework, this approach achieves strong performance even when labeled data is scarce. |
| ScholarGateDatová sada ↗ |
|
|