ScholarGate
Pembantu
Machine learningDeep learning / NLP / CV

Transformer Multimodus

Transformer Multimodus ialah lanjutan kepada seni bina Transformer standard untuk memproses dan menalar secara bersama ke atas dua atau lebih modaliti input — paling lazimnya teks dan imej, tetapi juga audio, video, atau data berstruktur. Lapisan perhatian silang modaliti membenarkan maklumat daripada satu modaliti memaklumkan perwakilan dalam modaliti lain, membolehkan tugasan seperti menjawab persoalan visual, penjanaan kapsyen imej, dan analisis sentimen multimodus.

Buka dalam MethodMindTidak lama lagiVideoTidak lama lagiDownload slides

Baca kaedah sepenuhnya

Ahli sahaja

Log masuk dengan akaun percuma untuk membaca bahagian ini.

Log masuk

Method map

The neighbourhood of related methods — select a node to explore.

Transformer Multimodus
Klasifikasi Berasaskan B…Klasifikasi ImejKlasifikasi Berasaskan B…Penyematan AyatTransformer VisiTransformer Boleh Dijela…Rangkaian Saraf Konvolus…Model Resapan MultimodusDoc2Vec MultimodaGAN Multimodal

+15 more

Sumber

  1. Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. Advances in Neural Information Processing Systems (NeurIPS), 32. link ↗
  2. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning Transferable Visual Models From Natural Language Supervision. Proceedings of the 38th International Conference on Machine Learning (ICML), PMLR 139. link ↗

Cara memetik halaman ini

ScholarGate. (2026, June 3). Multimodal Transformer (Cross-Modal Attention-Based Architecture). ScholarGate. https://scholargate.app/ms/deep-learning/multimodal-transformer

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side →

Dirujuk oleh

Transformer Boleh DijelaskanRangkaian Saraf Konvolusional Multimod (Multimodal Convolutional Neural Network)Model Resapan MultimodusDoc2Vec MultimodaGAN MultimodalRangkaian Saraf Graf Multimod (MM-GNN) menggabungkan data daripada pelbagai modGRU MultimodalKlasifikasi Imej MultimodalModel Topik LDA MultimodusLSTM MultimodusMultimodal Multilayer PerceptronPengecaman Entiti Bernama Multimodal (MNER)Deteksi Objek MultimodusSoalan Pelbagai Mod (Multimodal Question Answering)Rangkaian Saraf Berulang Multimod (Multimodal Recurrent Neural Network)Pembelajaran Penguatan Multimod (Multimodal Reinforcement Learning)Klasifikasi Multimoda Berasaskan RoBERTaPeringkasan Teks Multimod,Pemodelan Topik MultimodusMultimodal Word2Vec

Terjumpa masalah pada halaman ini? Laporkan atau cadangkan pembetulan →

ScholarGate — Multimodal Transformer (Multimodal Transformer (Cross-Modal Attention-Based Architecture)). Dicapai 2026-06-15 daripada https://scholargate.app/ms/deep-learning/multimodal-transformer · Set data: https://doi.org/10.5281/zenodo.20539026