ScholarGate
助手
Machine learningDeep learning / NLP / CV

多模态BERT分类

多模态BERT分类扩展了BERT Transformer架构，通过在最终分类头之前融合来自多种模态（最常见的是文本与图像配对）的表示，从而联合编码和分类这些数据。该方法在2019年前后通过MMBT和ViLBERT等模型被广泛引入，已成为处理那些仅凭文本或图像都无法提供足够信息以进行准确标注的任务的标准方法。

在 MethodMind 中打开即将推出视频即将推出Download slides

阅读完整方法

仅限会员

使用免费账户登录即可阅读本节。

登录

Method map

The neighbourhood of related methods — select a node to explore.

多模态BERT分类
CLIPVision Transformer多模态卷积神经网络多模态扩散模型多模态Doc2Vec多模态图神经网络多模态门控循环单元 (Multimodal GR…多模态图像分类多模态LDA主题模型多模态命名实体识别

+8 more

来源

  1. Kiela, D., Bhooshan, S., Firooz, H., Perez, E., & Testuggine, D. (2019). Supervised multimodal bitransformers for classifying images and text. arXiv preprint arXiv:1909.02950. link ↗
  2. Lu, J., Batra, D., Parikh, D., & Lee, S. (2019). ViLBERT: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Advances in Neural Information Processing Systems, 32. link ↗

如何引用本页

ScholarGate. (2026, June 3). Multimodal BERT-based Classification (Transformer Fusion of Text and Non-text Modalities). ScholarGate. https://scholargate.app/zh/deep-learning/multimodal-bert-based-classification

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Compare side by side →

被引用于

多模态卷积神经网络多模态扩散模型多模态Doc2Vec多模态图神经网络多模态门控循环单元 (Multimodal GRU)多模态图像分类多模态LDA主题模型多模态命名实体识别多模态问题解答多模态循环神经网络多模态 RoBERTa 分类多模态文本摘要多模态主题建模多模态Transformer多模态视觉变换器多模态Word2Vec

发现本页有问题？报告或提出修改建议 →

ScholarGate — Multimodal BERT-based Classification (Multimodal BERT-based Classification (Transformer Fusion of Text and Non-text Modalities)). 于 2026-06-15 检索自 https://scholargate.app/zh/deep-learning/multimodal-bert-based-classification · 数据集： https://doi.org/10.5281/zenodo.20539026