Linganisha mbinu

	Ufupishaji wa Maandishi Multimodal	Uainishaji unaotumia BERT
Nyanja	Ujifunzaji wa Kina	Ujifunzaji wa Kina
Familia	Machine learning	Machine learning
Mwaka wa asili	2018	2019
Mwanzilishi	Zhu et al. (pioneering MSMO framework)	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI Language)
Aina	Generative / extractive NLP with visual input	Pre-trained language model with fine-tuning
Chanzo asilia	Zhu, J., Li, H., Liu, T., Zhou, Y., Zhang, J., & Zong, C. (2018). MSMO: Multimodal Summarization with Multimodal Output. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), 4154–4164.	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics.
Majina mbadala	MMS, multimodal summarization, cross-modal summarization, vision-language summarization	BERT classifier, BERT fine-tuning for classification, BERT text classification, BERT-CLS
Zinazohusiana	5	4
Muhtasari	Multimodal text summarization generates a concise textual summary by jointly processing multiple input modalities — most commonly text and images, but also video frames or audio — using deep learning models that align visual and linguistic representations. The output is a natural-language summary that captures salient content from all available modalities.	BERT-based Classification fine-tunes Google's Bidirectional Encoder Representations from Transformers model on a labelled text dataset, replacing the generic pre-trained head with a task-specific classification layer. It exploits deep bidirectional context from hundreds of millions of pre-trained parameters to deliver state-of-the-art accuracy on short- and medium-length text classification tasks with relatively modest amounts of labelled data.