ScholarGate
Msaidizi
Machine learningDeep learning / NLP / CV

Transformer wa Maono wa Multimodal

Transformer wa Maono wa Multimodal (Multimodal ViT) unapanua usanifu wa Transformer wa Maono ili kuchakata na kuunganisha kwa pamoja uwakilishi kutoka kwa modi nyingi — kwa kawaida picha na maandishi — kwa kutumia mitambo ya kujitahidi na ya msalaba. Kwa kujifunza nafasi za kuingiza zilizoshirikiwa au zilizoambatana katika modi mbalimbali, huwezesha kazi kama vile kujibu maswali ya kuona, kurejesha picha-maandishi, msingi wa kuona, na kuandika picha.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Transformer wa Maono wa Multimodal
Uainishaji unaotumia BERTVision Transformer Iliyo…Uainishaji wa PichaUainishaji wa Multimodal…Transformer wa MaonoTransformer ya Maono Ina…Multilingual vision tran…Mchoro wa Usambazaji wa…Uainishaji wa Matukio wa…Ujifunzaji Tumizi wa Nji…

+1 more

Vyanzo

  1. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR). link ↗
  2. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., & Sutskever, I. (2021). Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML), PMLR 139. link ↗

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 3). Multimodal Vision Transformer (Multimodal ViT). ScholarGate. https://scholargate.app/sw/deep-learning/multimodal-vision-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side →

Imerejelewa na

Transformer ya Maono InayoelewekaMultilingual vision transformerMchoro wa Usambazaji wa Njia NyingiUainishaji wa Matukio wa Njia NyingiUjifunzaji Tumizi wa Njia Nyingi (Multimodal Reinforcement Learning)Transformer wa Maono unaojifundisha

Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →

ScholarGate — Multimodal Vision Transformer (Multimodal Vision Transformer (Multimodal ViT)). Imepatikana 2026-06-15 kutoka https://scholargate.app/sw/deep-learning/multimodal-vision-transformer · Seti ya data: https://doi.org/10.5281/zenodo.20539026