ScholarGate
Msaidizi
Machine learning

Uzingatio-mkuu wa nafsi (Multi-Head Self-Attention)

Uzingatio-mkuu wa nafsi, ulioanzishwa na Vaswani na wenzake mwaka 2017, ni utaratibu unaoruhusu kila nafasi katika mlolongo kuhesabu uhusiano wake na nafasi zingine zote kwa wakati mmoja. Ni kiini cha usanifu wa Transformer na msingi unaounga mkono BERT, GPT, na T5.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Vyanzo

  1. Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link
  2. Devlin, J. et al. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL. link

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 1). Multi-Head Self-Attention (Transformer Core). ScholarGate. https://scholargate.app/sw/deep-learning/self-attention-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side

Imerejelewa na

ScholarGateSelf-Attention (Multi-Head Self-Attention (Transformer Core)). Imepatikana 2026-06-15 kutoka https://scholargate.app/sw/deep-learning/self-attention-transformer · Seti ya data: https://doi.org/10.5281/zenodo.20539026