ScholarGate
助手

方法对比

并排查看您选择的方法;存在差异的行会高亮显示。

检索增强生成(RAG)×多头自注意力机制×
领域文本挖掘深度学习
方法族Process / pipelineMachine learning
起源年份20202017
提出者Lewis, Patrick et al. (Meta AI / Facebook AI Research)Vaswani, A. et al.
类型Hybrid retrieval + generation pipelineAttention mechanism (Transformer core)
开创性文献Lewis, P. et al. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems (NeurIPS), 33, 9459-9474. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
别名RAG, retrieval-augmented LLM, grounded generation, Erişim Destekli Metin Üretimi (RAG)Öz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
相关75
摘要Retrieval-Augmented Generation (RAG) is a natural-language-processing pipeline introduced by Lewis et al. in 2020 that strengthens a large language model (LLM) with evidence fetched at inference time from an external knowledge base. Instead of relying solely on what a model memorised during training, RAG first retrieves the most relevant passages from a document index and then hands those passages to the LLM as context, grounding the generated answer in verifiable, up-to-date information. The approach reduces hallucination and allows domain-specific or time-sensitive knowledge to be injected without retraining the model.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGate数据集
  1. v1
  2. 2 来源
  3. PUBLISHED
  1. v1
  2. 2 来源
  3. PUBLISHED

前往搜索 下载幻灯片

ScholarGate方法对比: Retrieval-Augmented Generation · Self-Attention. 于 2026-06-18 检索自 https://scholargate.app/zh/compare