Сравнение методов

	Мультимодальная классификация на основе RoBERTa	Мультимодальная классификация на основе BERT
Область	Глубокое обучение	Глубокое обучение
Семейство	Machine learning	Machine learning
Год появления	2019–2020	2019
Автор метода	Liu et al. (RoBERTa); multimodal extension by community	Kiela, D. et al.; Lu, J. et al.
Тип	Multimodal text + auxiliary feature classification	Multimodal transformer classifier
Основополагающий источник	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.	Kiela, D., Bhooshan, S., Firooz, H., Perez, E., & Testuggine, D. (2019). Supervised multimodal bitransformers for classifying images and text. arXiv preprint arXiv:1909.02950.
Другие названия	Multimodal RoBERTa, RoBERTa multimodal classifier, cross-modal RoBERTa classification, MM-RoBERTa	MMBT, multimodal transformer classification, BERT multimodal fusion, vision-language BERT classifier
Связанные	6	2
Сводка	Multimodal RoBERTa-based Classification combines the RoBERTa transformer encoder — a robustly optimised variant of BERT — with auxiliary modalities such as images, structured metadata, or tabular features. The fused representation is passed to a classification head, allowing the model to leverage both rich language understanding and non-textual signals simultaneously.	Multimodal BERT-based classification extends the BERT transformer architecture to jointly encode and classify data from multiple modalities — most commonly text paired with images — by fusing their representations before a final classification head. Introduced prominently around 2019 through models such as MMBT and ViLBERT, it has become a standard approach for tasks where neither text nor image alone carries sufficient information for accurate labeling.