Сравнение методов

	Мультимодальное обнаружение объектов	Мультимодальная классификация изображений
Область	Глубокое обучение	Глубокое обучение
Семейство	Machine learning	Machine learning
Год появления	2015–2019	2011–2021
Автор метода	Multiple contributors (e.g., Chen & Deng, Liang et al.)	Ngiam et al.; Radford et al. (CLIP)
Тип	Fusion-based deep detection	Multimodal supervised classification
Основополагающий источник	Liu, Y., Zhang, F., Li, Y., & Lv, H. (2022). Multimodal Object Detection via Bayesian Fusion. IEEE Transactions on Image Processing, 31, 5953–5965.	Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. Proceedings of the 38th International Conference on Machine Learning (ICML), PMLR 139, 8748–8763.
Другие названия	multi-sensor object detection, cross-modal detection, RGB-D object detection, fusion-based object detection	multimodal visual classification, image-text classification, vision-language classification, cross-modal image classification
Связанные	6	6
Сводка	Multimodal object detection extends single-modality object detectors by jointly processing signals from multiple sensor types — such as RGB cameras, depth sensors, LiDAR, radar, or text descriptions — to localize and classify objects with higher accuracy and robustness than any single modality alone. Fusion of complementary information is the core design principle.	Multimodal image classification extends standard visual classification by incorporating additional modalities — such as text captions, audio, or structured metadata — alongside image features. Separate encoders process each modality, their representations are fused, and a joint classifier assigns the target label. Models such as CLIP demonstrate that image–text alignment enables zero-shot and few-shot image classification at scale.