ScholarGate
Pembantu

Bandingkan kaedah

Semak kaedah pilihan anda secara bersebelahan; baris yang berbeza akan diserlahkan.

Model Jujukan-ke-Jujukan×Perhatian Kendiri Pelbagai Kepala×
BidangPembelajaran MendalamPembelajaran Mendalam
KeluargaMachine learningMachine learning
Tahun asal20142017
PengasasSutskever, I.; Cho, K.Vaswani, A. et al.
JenisEncoder-decoder neural network (deep learning)Attention mechanism (Transformer core)
Sumber perintisSutskever, I., Vinyals, O. & Le, Q. V. (2014). Sequence to Sequence Learning with Neural Networks. NeurIPS. link ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
AliasDizi-Dizi Modeli (Seq2Seq — Encoder-Decoder), encoder-decoder model, seq2seq, sequence to sequence learningÖz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Berkaitan55
RingkasanThe sequence-to-sequence (Seq2Seq) model, introduced by Sutskever, Vinyals and Le and by Cho and colleagues in 2014, is an encoder-decoder neural network that maps a variable-length input sequence to a variable-length output sequence. It is the foundation of machine translation, text summarization, dialogue systems and code generation.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSet data
  1. v1
  2. 2 Sumber
  3. PUBLISHED
  1. v1
  2. 2 Sumber
  3. PUBLISHED

Pergi ke carian Muat turun slaid

ScholarGateBandingkan kaedah: Sequence-to-Sequence Model · Self-Attention. Dicapai 2026-06-15 daripada https://scholargate.app/ms/compare