ScholarGate
Pembantu

Bandingkan kaedah

Semak kaedah pilihan anda secara bersebelahan; baris yang berbeza akan diserlahkan.

Multimodal Multilayer Perceptron×Penyematan Zarah Pelbagai Mod (Multimodal Sentence Embeddings)×
BidangPembelajaran MendalamPembelajaran Mendalam
KeluargaMachine learningMachine learning
Tahun asal2011 (multimodal extension); 1986 (MLP backpropagation)2013–2021
PengasasNgiam et al. / Rumelhart, Hinton & Williams (MLP foundations)Frome et al. (DeViSE, 2013); popularized by Radford et al. (CLIP, 2021)
JenisFeedforward neural network with multi-stream fusionRepresentation learning model
Sumber perintisNgiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., & Ng, A. Y. (2011). Multimodal deep learning. In Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 689–696. link ↗Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML), pp. 8748–8763. PMLR. link ↗
AliasMM-MLP, multimodal MLP, multi-input feedforward network, fusion multilayer perceptronmultimodal embeddings, cross-modal sentence embeddings, vision-language embeddings, joint image-text embeddings
Berkaitan51
RingkasanA Multimodal Multilayer Perceptron (MM-MLP) is a feedforward neural network that ingests features from two or more heterogeneous input modalities — such as structured tabular data, text embeddings, and image feature vectors — by encoding each stream separately and fusing them into a shared representation before passing it through fully connected layers to produce a classification or regression output.Multimodal sentence embeddings map text and images (and sometimes audio or video) into a shared continuous vector space, so that semantically related pairs from different modalities land close together. Trained by contrastive objectives on large paired corpora, these representations power cross-modal retrieval, zero-shot classification, and vision-language reasoning.
ScholarGateSet data
  1. v1
  2. 2 Sumber
  3. PUBLISHED
  1. v1
  2. 2 Sumber
  3. PUBLISHED

Pergi ke carian Muat turun slaid

ScholarGateBandingkan kaedah: Multimodal Multilayer Perceptron · Multimodal Sentence Embeddings. Dicapai 2026-06-18 daripada https://scholargate.app/ms/compare