手法を比較

	マルチモーダルDoc2Vec	マルチモーダル文埋め込み
分野	深層学習	深層学習
系統	Machine learning	Machine learning
提唱年	2014–2017	2013–2021
提唱者	Le, Q. V. & Mikolov, T. (Doc2Vec core); multimodal extensions by various authors post-2014	Frome et al. (DeViSE, 2013); popularized by Radford et al. (CLIP, 2021)
種類	Multimodal document embedding	Representation learning model
原典	Le, Q. V., & Mikolov, T. (2014). Distributed Representations of Sentences and Documents. Proceedings of the 31st International Conference on Machine Learning (ICML), PMLR 32(2), 1188–1196.	Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML), pp. 8748–8763. PMLR.
別名	Multimodal Paragraph Vector, Cross-modal Doc2Vec, Multi-source PV-DM, Multimodal Document Embedding	multimodal embeddings, cross-modal sentence embeddings, vision-language embeddings, joint image-text embeddings
関連	6	1
概要	Multimodal Doc2Vec extends the Doc2Vec paragraph-vector framework to incorporate information from more than one modality — typically text alongside images, audio, or structured metadata — producing a shared document-level embedding that captures semantics from multiple sources simultaneously. It is used for cross-modal retrieval, multi-source classification, and document representation where text alone is insufficient.	Multimodal sentence embeddings map text and images (and sometimes audio or video) into a shared continuous vector space, so that semantically related pairs from different modalities land close together. Trained by contrastive objectives on large paired corpora, these representations power cross-modal retrieval, zero-shot classification, and vision-language reasoning.