ScholarGate
Asistent

Compară metode

Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.

RNN bidirecțional×Atenție Multi-Capete (Multi-Head Self-Attention)×
DomeniuÎnvățare profundăÎnvățare profundă
FamilieMachine learningMachine learning
Anul apariției19972017
Autorul originalSchuster, M. & Paliwal, K.K.Vaswani, A. et al.
TipRecurrent neural network (sequence model)Attention mechanism (Transformer core)
Sursa seminalăSchuster, M. & Paliwal, K.K. (1997). Bidirectional Recurrent Neural Networks. IEEE Transactions on Signal Processing, 45(11), 2673–2681. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
Denumiri alternativeÇift Yönlü RNN / BiLSTM / BiGRU, bidirectional recurrent neural network, BiLSTM, BiGRUÖz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Înrudite55
RezumatA Bidirectional RNN, introduced by Schuster and Paliwal in 1997, processes a sequence in both forward and backward directions so that every position has access to its full surrounding context. With LSTM or GRU cells (BiLSTM/BiGRU) it is the standard approach for named-entity recognition, sequence labelling, and speech recognition.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSet de date
  1. v1
  2. 2 Surse
  3. PUBLISHED
  1. v1
  2. 2 Surse
  3. PUBLISHED

Mergi la căutare Descarcă prezentarea

ScholarGateCompară metode: Bidirectional RNN · Self-Attention. Preluat la 2026-06-18 de pe https://scholargate.app/ro/compare