ScholarGate
Asistent

Compară metode

Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.

Clasificare bazată pe RoBERTa multimodală×Transformer Multimodal×
DomeniuÎnvățare profundăÎnvățare profundă
FamilieMachine learningMachine learning
Anul apariției2019–20202019–2021
Autorul originalLiu et al. (RoBERTa); multimodal extension by communityLu et al. (ViLBERT); Radford et al. (CLIP)
TipMultimodal text + auxiliary feature classificationCross-modal attention-based deep learning model
Sursa seminalăLiu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692. link ↗Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. Advances in Neural Information Processing Systems (NeurIPS), 32. link ↗
Denumiri alternativeMultimodal RoBERTa, RoBERTa multimodal classifier, cross-modal RoBERTa classification, MM-RoBERTamultimodal attention model, cross-modal transformer, vision-language transformer, multi-modal fusion transformer
Înrudite65
RezumatMultimodal RoBERTa-based Classification combines the RoBERTa transformer encoder — a robustly optimised variant of BERT — with auxiliary modalities such as images, structured metadata, or tabular features. The fused representation is passed to a classification head, allowing the model to leverage both rich language understanding and non-textual signals simultaneously.A Multimodal Transformer extends the standard Transformer architecture to process and jointly reason over two or more input modalities — most commonly text and images, but also audio, video, or structured data. Cross-modal attention layers allow information from one modality to inform representations in another, enabling tasks such as visual question answering, image captioning, and multimodal sentiment analysis.
ScholarGateSet de date
  1. v1
  2. 2 Surse
  3. PUBLISHED
  1. v1
  2. 2 Surse
  3. PUBLISHED

Mergi la căutare Descarcă prezentarea

ScholarGateCompară metode: Multimodal RoBERTa-based Classification · Multimodal Transformer. Preluat la 2026-06-17 de pe https://scholargate.app/ro/compare