ScholarGate
Asistent

Uporedite metode

Pregledajte izabrane metode jednu pored druge; redovi koji se razlikuju su istaknuti.

Bidirectional RNN×Višeglava sopstvena pažnja×
OblastDuboko učenjeDuboko učenje
PorodicaMachine learningMachine learning
Godina nastanka19972017
TvoracSchuster, M. & Paliwal, K.K.Vaswani, A. et al.
TipRecurrent neural network (sequence model)Attention mechanism (Transformer core)
Temeljni izvorSchuster, M. & Paliwal, K.K. (1997). Bidirectional Recurrent Neural Networks. IEEE Transactions on Signal Processing, 45(11), 2673–2681. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
Drugi naziviÇift Yönlü RNN / BiLSTM / BiGRU, bidirectional recurrent neural network, BiLSTM, BiGRUÖz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Srodne55
SažetakA Bidirectional RNN, introduced by Schuster and Paliwal in 1997, processes a sequence in both forward and backward directions so that every position has access to its full surrounding context. With LSTM or GRU cells (BiLSTM/BiGRU) it is the standard approach for named-entity recognition, sequence labelling, and speech recognition.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSkup podataka
  1. v1
  2. 2 Izvori
  3. PUBLISHED
  1. v1
  2. 2 Izvori
  3. PUBLISHED

Idi na pretragu Preuzmi slajdove

ScholarGateUporedite metode: Bidirectional RNN · Self-Attention. Preuzeto 2026-06-18 sa https://scholargate.app/sr/compare