השוואת שיטות

	רשת נוירונים גרפית רב-אופנית	רשת קונבולוציה רב-אופנית (Multimodal Convolutional Neural Network)
תחום	למידה עמוקה	למידה עמוקה
משפחה	Machine learning	Machine learning
שנת המקור	2019–2020	2011
הוגה השיטה	Kipf & Welling (GNN foundation); extended to multimodal settings by multiple research groups c. 2019–2020	Ngiam, J. et al. / multiple groups
סוג	Graph-based deep learning with multimodal input fusion	Multimodal deep learning model
מקור מכונן	Kipf, T. N., & Welling, M. (2017). Semi-Supervised Classification with Graph Convolutional Networks. International Conference on Learning Representations (ICLR).	Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., & Ng, A. Y. (2011). Multimodal deep learning. In Proceedings of the 28th International Conference on Machine Learning (ICML), 689–696.
כינויים	MM-GNN, Multimodal GNN, Multi-modal Graph Network, Cross-modal Graph Neural Network	MM-CNN, multimodal CNN, multi-input CNN, cross-modal convolutional network
קשורות	6	5
תקציר	A Multimodal Graph Neural Network (MM-GNN) combines data from multiple modalities — such as text, images, and structured features — into a unified graph structure and applies graph-based message passing to learn joint representations. It enables relational reasoning across heterogeneous data sources, going beyond what unimodal or simple concatenation approaches can capture.	A Multimodal Convolutional Neural Network (MM-CNN) processes and fuses two or more input modalities — such as images and text, or video and audio — through dedicated convolutional branches, learning a shared representation that captures complementary signals from each source. The fused representation drives a downstream task such as classification, regression, or retrieval.