ScholarGate
Pembantu

Bandingkan kaedah

Semak kaedah pilihan anda secara bersebelahan; baris yang berbeza akan diserlahkan.

Multimodal Word2Vec×Transformer Multimodus×
BidangPembelajaran MendalamPembelajaran Mendalam
KeluargaMachine learningMachine learning
Tahun asal20142019–2021
PengasasBruni, E., Tran, N.-K., & Baroni, M. (building on Mikolov et al.)Lu et al. (ViLBERT); Radford et al. (CLIP)
JenisMultimodal word embedding modelCross-modal attention-based deep learning model
Sumber perintisBruni, E., Tran, N.-K., & Baroni, M. (2014). Multimodal Distributional Semantics. Journal of Artificial Intelligence Research, 49, 1–47. DOI ↗Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. Advances in Neural Information Processing Systems (NeurIPS), 32. link ↗
Aliasmultimodal word embeddings, visual-linguistic Word2Vec, cross-modal Word2Vec, MM-W2Vmultimodal attention model, cross-modal transformer, vision-language transformer, multi-modal fusion transformer
Berkaitan55
RingkasanMultimodal Word2Vec extends the classic Word2Vec framework by grounding word representations in perceptual signals — typically image features — alongside distributional text statistics. The result is word vectors that capture both linguistic co-occurrence patterns and visual meaning, enabling richer semantic similarity judgements and better performance on concept-level tasks where purely text-based embeddings fall short.A Multimodal Transformer extends the standard Transformer architecture to process and jointly reason over two or more input modalities — most commonly text and images, but also audio, video, or structured data. Cross-modal attention layers allow information from one modality to inform representations in another, enabling tasks such as visual question answering, image captioning, and multimodal sentiment analysis.
ScholarGateSet data
  1. v1
  2. 2 Sumber
  3. PUBLISHED
  1. v1
  2. 2 Sumber
  3. PUBLISHED

Pergi ke carian Muat turun slaid

ScholarGateBandingkan kaedah: Multimodal Word2Vec · Multimodal Transformer. Dicapai 2026-06-17 daripada https://scholargate.app/ms/compare