Σύγκριση μεθόδων
Εξετάστε τις επιλεγμένες μεθόδους δίπλα-δίπλα· οι γραμμές που διαφέρουν επισημαίνονται.
| Μηχανισμός Προσοχής× | Επαναλαμβανόμενη Μονάδα με Πύλες (GRU)× | |
|---|---|---|
| Πεδίο | Βαθιά Μάθηση | Βαθιά Μάθηση |
| Οικογένεια | Machine learning | Machine learning |
| Έτος προέλευσης≠ | 2015 | 2014 |
| Δημιουργός≠ | Bahdanau, D.; Luong, M.T. | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. |
| Τύπος≠ | Neural attention layer (encoder-decoder) | Recurrent neural network with gating |
| Θεμελιώδης πηγή≠ | Bahdanau, D., Cho, K. & Bengio, Y. (2015). Neural Machine Translation by Jointly Learning to Align and Translate. ICLR. link ↗ | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In Proceedings of EMNLP 2014, pp. 1724–1734. link ↗ |
| Εναλλακτικές ονομασίες≠ | Dikkat Mekanizması (Bahdanau / Luong Attention), dikkat mekanizmasi, neural attention, additive attention | GRU, GRU network, gated RNN, GRU cell |
| Συναφείς≠ | 5 | 3 |
| Σύνοψη≠ | The attention mechanism, introduced by Bahdanau, Cho and Bengio in 2015 and refined by Luong, Pham and Manning the same year, lets a sequence decoder dynamically learn which of the encoder's outputs to focus on at each step. Before the Transformer, it substantially improved machine-translation quality by freeing models from compressing an entire input into a single fixed vector. | The Gated Recurrent Unit (GRU), introduced by Cho et al. in 2014, is a streamlined recurrent neural network that uses two learned gates — an update gate and a reset gate — to selectively retain or discard information across time steps, enabling effective sequence modelling with fewer parameters than LSTM. |
| ScholarGateΣύνολο δεδομένων ↗ |
|
|