ScholarGate
Asistenti

Krahasoni metodat

Shqyrtoni metodat e zgjedhura krah për krah; rreshtat që ndryshojnë janë të theksuar.

Përgjigje e Shtuar me Kërkim (RAG)×Vetë-vëmendja me shumë koka×
FushaNxjerrja e tekstitMësimi i thellë
FamiljaProcess / pipelineMachine learning
Viti i origjinës20202017
KrijuesiLewis, Patrick et al. (Meta AI / Facebook AI Research)Vaswani, A. et al.
LlojiHybrid retrieval + generation pipelineAttention mechanism (Transformer core)
Burimi themeluesLewis, P. et al. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems (NeurIPS), 33, 9459-9474. DOI ↗Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS. link ↗
Emërtime të tjeraRAG, retrieval-augmented LLM, grounded generation, Erişim Destekli Metin Üretimi (RAG)Öz-Dikkat ve Çok Başlı Dikkat (Multi-Head Self-Attention), öz-dikkat, multi-head attention, scaled dot-product attention
Të lidhura75
PërmbledhjaRetrieval-Augmented Generation (RAG) is a natural-language-processing pipeline introduced by Lewis et al. in 2020 that strengthens a large language model (LLM) with evidence fetched at inference time from an external knowledge base. Instead of relying solely on what a model memorised during training, RAG first retrieves the most relevant passages from a document index and then hands those passages to the LLM as context, grounding the generated answer in verifiable, up-to-date information. The approach reduces hallucination and allows domain-specific or time-sensitive knowledge to be injected without retraining the model.Multi-head self-attention, introduced by Vaswani and colleagues in 2017, is the mechanism that lets every position in a sequence compute its relationship to all other positions in parallel. It is the core of the Transformer architecture and the foundation underneath BERT, GPT, and T5.
ScholarGateSeti i të dhënave
  1. v1
  2. 2 Burimet
  3. PUBLISHED
  1. v1
  2. 2 Burimet
  3. PUBLISHED

Shko te kërkimi Shkarko diapozitivat

ScholarGateKrahasoni metodat: Retrieval-Augmented Generation · Self-Attention. Marrë më 2026-06-18 nga https://scholargate.app/sq/compare