ScholarGate
Asistent

Compară metode

Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.

Modelul de topicuri LDA multimodal×Transformer Multimodal×
DomeniuÎnvățare profundăÎnvățare profundă
FamilieMachine learningMachine learning
Anul apariției20032019–2021
Autorul originalBlei, D. M. & Jordan, M. I.Lu et al. (ViLBERT); Radford et al. (CLIP)
TipProbabilistic generative topic model (multimodal)Cross-modal attention-based deep learning model
Sursa seminalăBlei, D. M. & Jordan, M. I. (2003). Modeling annotated data. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 127–134. DOI ↗Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. Advances in Neural Information Processing Systems (NeurIPS), 32. link ↗
Denumiri alternativeMultimodal LDA, mm-LDA, multimodal topic model, cross-modal LDAmultimodal attention model, cross-modal transformer, vision-language transformer, multi-modal fusion transformer
Înrudite65
RezumatMultimodal LDA extends Latent Dirichlet Allocation to jointly model multiple data modalities — most often text and images — within a single probabilistic topic framework. Each document or data instance is represented as a mixture of latent topics shared across modalities, enabling the model to discover coherent themes that align visual and linguistic content simultaneously.A Multimodal Transformer extends the standard Transformer architecture to process and jointly reason over two or more input modalities — most commonly text and images, but also audio, video, or structured data. Cross-modal attention layers allow information from one modality to inform representations in another, enabling tasks such as visual question answering, image captioning, and multimodal sentiment analysis.
ScholarGateSet de date
  1. v1
  2. 2 Surse
  3. PUBLISHED
  1. v1
  2. 2 Surse
  3. PUBLISHED

Mergi la căutare Descarcă prezentarea

ScholarGateCompară metode: Multimodal LDA topic model · Multimodal Transformer. Preluat la 2026-06-18 de pe https://scholargate.app/ro/compare