ScholarGate
Asistent

Uporedite metode

Pregledajte izabrane metode jednu pored druge; redovi koji se razlikuju su istaknuti.

Генерација уз побољшано преузимање (RAG)×Višeglava sopstvena pažnja×
OblastRudarenje tekstaDuboko učenje
PorodicaProcess / pipelineMachine learning
Godina nastanka20202017
TvoracLewis, Patrick et al. (Meta AI / Facebook AI Research)Vaswani, A. et al.
TipHybrid retrieval + generation pipelineAttention mechanism (Transformer core)
Temeljni izvorLewis, P. et al. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems (NeurIPS), 33, 9459-9474. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
Drugi naziviRAG, retrieval-augmented LLM, grounded generation, Erişim Destekli Metin Üretimi (RAG)Öz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Srodne75
SažetakRetrieval-Augmented Generation (RAG) is a natural-language-processing pipeline introduced by Lewis et al. in 2020 that strengthens a large language model (LLM) with evidence fetched at inference time from an external knowledge base. Instead of relying solely on what a model memorised during training, RAG first retrieves the most relevant passages from a document index and then hands those passages to the LLM as context, grounding the generated answer in verifiable, up-to-date information. The approach reduces hallucination and allows domain-specific or time-sensitive knowledge to be injected without retraining the model.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSkup podataka
  1. v1
  2. 2 Izvori
  3. PUBLISHED
  1. v1
  2. 2 Izvori
  3. PUBLISHED

Idi na pretragu Preuzmi slajdove

ScholarGateUporedite metode: Retrieval-Augmented Generation · Self-Attention. Preuzeto 2026-06-18 sa https://scholargate.app/sr/compare