So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Xử lý ngôn ngữ tự nhiên đa phương thức× | Cơ chế chú ý (Attention Mechanism)× | |
|---|---|---|
| Lĩnh vực≠ | Khai phá văn bản | Học sâu |
| Họ≠ | Process / pipeline | Machine learning |
| Năm ra đời≠ | 2021 (modern era, CLIP onward) | 2015 |
| Người khởi xướng≠ | Radford et al. (OpenAI) — CLIP, 2021; Li et al. — BLIP-2, 2023 | Bahdanau, D.; Luong, M.T. |
| Loại≠ | Cross-modal understanding and generation pipeline | Neural attention layer (encoder-decoder) |
| Công trình gốc≠ | Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., & Sutskever, I. (2021). Learning Transferable Visual Models From Natural Language Supervision. Proceedings of the 38th International Conference on Machine Learning (ICML), 8748–8763. link ↗ | Bahdanau, D., Cho, K. & Bengio, Y. (2015). Neural Machine Translation by Jointly Learning to Align and Translate. ICLR. link ↗ |
| Tên gọi khác≠ | Çok Kipli NLP (Multimodal NLP), vision-language models, multimodal learning | Dikkat Mekanizması (Bahdanau / Luong Attention), dikkat mekanizmasi, neural attention, additive attention |
| Liên quan≠ | 4 | 5 |
| Tóm tắt≠ | Multimodal NLP is a family of natural-language-processing pipelines that combine text with one or more additional data modalities — most commonly images, but also audio and video — to perform understanding and generation tasks such as visual question answering, image captioning, and multimodal sentiment recognition. The field gained its modern form with CLIP (Radford et al., 2021) and has since advanced through architectures such as BLIP-2 (Li et al., 2023) that bridge frozen image encoders and large language models. | The attention mechanism, introduced by Bahdanau, Cho and Bengio in 2015 and refined by Luong, Pham and Manning the same year, lets a sequence decoder dynamically learn which of the encoder's outputs to focus on at each step. Before the Transformer, it substantially improved machine-translation quality by freeing models from compressing an entire input into a single fixed vector. |
| ScholarGateBộ dữ liệu ↗ |
|
|