Machine learningDeep learning / NLP / CV

Transformer Inayojisimamia Kujifunza

Transformer inayojisimamia kujifunza ni mtandao wa Transformer uliopatiwa mafunzo ya awali kwa kutumia ishara za usimamizi zilizojengwa kiotomatiki — kama vile utabiri wa tokeni iliyofichwa au utabiri wa sentensi inayofuata — badala ya lebo zilizowekwa na binadamu. Uwakilishi unaotokana kisha hurekebishwa vizuri au kuchunguzwa kwenye kazi za chini. BERT, GPT, na ViT (Vision Transformer katika hali ya uundaji wa picha zilizofichwa) ndio mifano inayojulikana zaidi ya dhana hii.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Transformer Inayojisimamia Kujifunza

Uainishaji unaotumia BERT Transformer Iliyoboreshwa Uainishaji unaotegemea R…Self-supervised convolut…Sentence Embeddings (Vib…Transformer Zinazoeleka GRU Inayojisimamia Self-supervised Sentence…Transformer yenye usimam…Transformer ya Usimamizi…

Vyanzo

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186. DOI: 10.18653/v1/N19-1423 ↗
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, 30. link ↗

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 3). Self-supervised Transformer (Pretraining with Self-generated Supervision). ScholarGate. https://scholargate.app/sw/deep-learning/self-supervised-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Uainishaji unaotumia BERTUjifunzaji wa Kina↔ compare
Transformer IliyoboreshwaUjifunzaji wa Kina↔ compare
Uainishaji unaotegemea RoBERTaUjifunzaji wa Kina↔ compare
Self-supervised convolutional neural networkUjifunzaji wa Kina↔ compare
Sentence Embeddings (Vibandiko vya Sentensi)Ujifunzaji wa Kina↔ compare

Compare side by side →

Imerejelewa na

Transformer Zinazoeleka Self-supervised convolutional neural network GRU Inayojisimamia Self-supervised Sentence Embeddings Transformer yenye usimamizi-nusu Transformer ya Usimamizi dhaifu

Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →