Sammenlign metoder
Gjennomgå de valgte metodene side om side; rader som avviker, er uthevet.
| Fintunet rekurrent nevralt nettverk× | Residuelle nevrale nettverk× | |
|---|---|---|
| Fagfelt | Dyp læring | Dyp læring |
| Familie | Machine learning | Machine learning |
| Opprinnelsesår≠ | 2015–2018 | 1986–1990 |
| Opphavsperson≠ | Popularised by Howard & Ruder (ULMFiT, 2018); RNN fine-tuning concept developed iteratively in the NLP community from ~2015 | Rumelhart, D. E.; Elman, J. L. |
| Type≠ | Transfer learning / sequential model adaptation | Sequential neural network |
| Opprinnelig kilde≠ | Howard, J. & Ruder, S. (2018). Universal Language Model Fine-Tuning for Text Classification. Proceedings of ACL 2018, 328–339. DOI ↗ | Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179–211. DOI ↗ |
| Alias | Fine-Tuned RNN, RNN Fine-Tuning, domain-adapted RNN, pre-trained RNN with downstream adaptation | RNN, Elman network, Jordan network, simple recurrent network |
| Relaterte≠ | 6 | 3 |
| Sammendrag≠ | A Fine-Tuned Recurrent Neural Network (RNN) starts from a model pre-trained on large corpora or time-series data and adapts its weights to a specific downstream task through controlled gradient updates. The approach dramatically cuts the labeled data needed for strong sequence modeling performance in text classification, named entity recognition, sentiment analysis, and related tasks. | A Recurrent Neural Network (RNN) is a class of neural network designed to process sequential data by maintaining a hidden state that carries information across time steps. Introduced in its modern form by Rumelhart et al. (1986) and further shaped by Elman (1990), RNNs became the dominant architecture for sequence modelling in NLP, speech, and time-series analysis before the rise of attention-based models. |
| ScholarGateDatasett ↗ |
|
|