Módszerek összehasonlítása

	Multimodal Doc2Vec	Multimodális mondatbeágyazások
Tudományterület	Mélytanulás	Mélytanulás
Módszercsalád	Machine learning	Machine learning
Keletkezés éve	2014–2017	2013–2021
Megalkotó	Le, Q. V. & Mikolov, T. (Doc2Vec core); multimodal extensions by various authors post-2014	Frome et al. (DeViSE, 2013); popularized by Radford et al. (CLIP, 2021)
Típus	Multimodal document embedding	Representation learning model
Alapmű	Le, Q. V., & Mikolov, T. (2014). Distributed Representations of Sentences and Documents. Proceedings of the 31st International Conference on Machine Learning (ICML), PMLR 32(2), 1188–1196.	Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML), pp. 8748–8763. PMLR.
Alternatív nevek	Multimodal Paragraph Vector, Cross-modal Doc2Vec, Multi-source PV-DM, Multimodal Document Embedding	multimodal embeddings, cross-modal sentence embeddings, vision-language embeddings, joint image-text embeddings
Kapcsolódó	6	1
Összefoglaló	Multimodal Doc2Vec extends the Doc2Vec paragraph-vector framework to incorporate information from more than one modality — typically text alongside images, audio, or structured metadata — producing a shared document-level embedding that captures semantics from multiple sources simultaneously. It is used for cross-modal retrieval, multi-source classification, and document representation where text alone is insufficient.	Multimodal sentence embeddings map text and images (and sometimes audio or video) into a shared continuous vector space, so that semantically related pairs from different modalities land close together. Trained by contrastive objectives on large paired corpora, these representations power cross-modal retrieval, zero-shot classification, and vision-language reasoning.