So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Cơ chế chú ý (Attention Mechanism)× | Cổng Lặp Lại Có Cổng (GRU)× | |
|---|---|---|
| Lĩnh vực | Học sâu | Học sâu |
| Họ | Machine learning | Machine learning |
| Năm ra đời≠ | 2015 | 2014 |
| Người khởi xướng≠ | Bahdanau, D.; Luong, M.T. | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. |
| Loại≠ | Neural attention layer (encoder-decoder) | Recurrent neural network with gating |
| Công trình gốc≠ | Bahdanau, D., Cho, K. & Bengio, Y. (2015). Neural Machine Translation by Jointly Learning to Align and Translate. ICLR. link ↗ | Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In Proceedings of EMNLP 2014, pp. 1724–1734. link ↗ |
| Tên gọi khác≠ | Dikkat Mekanizması (Bahdanau / Luong Attention), dikkat mekanizmasi, neural attention, additive attention | GRU, GRU network, gated RNN, GRU cell |
| Liên quan≠ | 5 | 3 |
| Tóm tắt≠ | The attention mechanism, introduced by Bahdanau, Cho and Bengio in 2015 and refined by Luong, Pham and Manning the same year, lets a sequence decoder dynamically learn which of the encoder's outputs to focus on at each step. Before the Transformer, it substantially improved machine-translation quality by freeing models from compressing an entire input into a single fixed vector. | The Gated Recurrent Unit (GRU), introduced by Cho et al. in 2014, is a streamlined recurrent neural network that uses two learned gates — an update gate and a reset gate — to selectively retain or discard information across time steps, enabling effective sequence modelling with fewer parameters than LSTM. |
| ScholarGateBộ dữ liệu ↗ |
|
|