ScholarGate
Msaidizi

Linganisha mbinu

Pitia mbinu ulizochagua bega kwa bega; safu zinazotofautiana zinaangaziwa.

Uzalishaji Ulioimarishwa kwa Urejeshaji (RAG)×Uzingatio-mkuu wa nafsi (Multi-Head Self-Attention)×
NyanjaUchimbaji wa MatiniUjifunzaji wa Kina
FamiliaProcess / pipelineMachine learning
Mwaka wa asili20202017
MwanzilishiLewis, Patrick et al. (Meta AI / Facebook AI Research)Vaswani, A. et al.
AinaHybrid retrieval + generation pipelineAttention mechanism (Transformer core)
Chanzo asiliaLewis, P. et al. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems (NeurIPS), 33, 9459-9474. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
Majina mbadalaRAG, retrieval-augmented LLM, grounded generation, Erişim Destekli Metin Üretimi (RAG)Öz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Zinazohusiana75
MuhtasariRetrieval-Augmented Generation (RAG) is a natural-language-processing pipeline introduced by Lewis et al. in 2020 that strengthens a large language model (LLM) with evidence fetched at inference time from an external knowledge base. Instead of relying solely on what a model memorised during training, RAG first retrieves the most relevant passages from a document index and then hands those passages to the LLM as context, grounding the generated answer in verifiable, up-to-date information. The approach reduces hallucination and allows domain-specific or time-sensitive knowledge to be injected without retraining the model.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSeti ya data
  1. v1
  2. 2 Vyanzo
  3. PUBLISHED
  1. v1
  2. 2 Vyanzo
  3. PUBLISHED

Nenda kwenye utafutaji Pakua slaidi

ScholarGateLinganisha mbinu: Retrieval-Augmented Generation · Self-Attention. Imepatikana 2026-06-18 kutoka https://scholargate.app/sw/compare