ScholarGate
Msaidizi
Machine learningDeep learning / NLP / CV

Transformeri wa Multimodal

Transformeri wa Multimodal huongeza usanifu wa kawaida wa Transformer ili kuchakata na kuunganisha kwa pamoja zaidi ya aina mbili za pembejeo — kwa kawaida maandishi na picha, lakini pia sauti, video, au data iliyopangwa. Safu za umakini wa pande mbili huruhusu habari kutoka kwa aina moja kuathiri uwakilishi katika nyingine, ikiwezesha majukumu kama vile kujibu maswali ya kuona, kuandika picha, na uchambuzi wa hisia multimodal.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Transformeri wa Multimodal
Uainishaji unaotumia BERTUainishaji wa PichaUainishaji wa Multimodal…Sentence Embeddings (Vib…Transformer wa MaonoTransformer ZinazoelekaMultimodal Convolutional…Mchoro wa Usambazaji wa…Multimodal Doc2VecMultimodal GAN

+15 more

Vyanzo

  1. Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. Advances in Neural Information Processing Systems (NeurIPS), 32. link ↗
  2. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning Transferable Visual Models From Natural Language Supervision. Proceedings of the 38th International Conference on Machine Learning (ICML), PMLR 139. link ↗

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 3). Multimodal Transformer (Cross-Modal Attention-Based Architecture). ScholarGate. https://scholargate.app/sw/deep-learning/multimodal-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side →

Imerejelewa na

Transformer ZinazoelekaMultimodal Convolutional Neural NetworkMchoro wa Usambazaji wa Njia NyingiMultimodal Doc2VecMultimodal GANMtandao wa Neurali wa Mwingiliano wa Njia NyingiGRU ya Njia Nyingi (Multimodal GRU)Uainishaji wa Picha wa MultimodalKielelezo cha Mada cha Multimodal LDAMultimodal LSTMKielelezo cha Tabaka Nyingi cha Njia NyingiUtambuzi wa Majina ya Entititi za MultimodalUtambuzi wa vitu vingi (Multimodal Object Detection)Maswali ya Majibu ya MultimodalMtandao wa Kurudiwa wa Njia Nyingi (Multimodal Recurrent Neural Network)Ujifunzaji Tumizi wa Njia Nyingi (Multimodal Reinforcement Learning)Uainishaji wa RoBERTa unaotumia Njia NyingiUfupishaji wa Maandishi MultimodalUundaji wa mada multimodalMultimodal Word2Vec

Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →

ScholarGate — Multimodal Transformer (Multimodal Transformer (Cross-Modal Attention-Based Architecture)). Imepatikana 2026-06-15 kutoka https://scholargate.app/sw/deep-learning/multimodal-transformer · Seti ya data: https://doi.org/10.5281/zenodo.20539026