Course contentsShow
← AI Engineering
Lesson 325 of 1,8869. Retrieval-Augmented Generation (RAG) - BasicsFree lesson

What is Retrieval-Augmented Generation

Understanding the RAG pattern: combining external knowledge retrieval with LLM generation to ground responses in facts.

What is Retrieval-Augmented Generation?

What you'll learn: How RAG combines external knowledge retrieval with LLM generation to produce factual, grounded responses.


Large Language Models are incredibly powerful at generating human-like text, but they have a critical limitation: they only "know" what was in their training data. They can't access real-time information, your company's internal documents, or specific knowledge bases. This is where Retrieval-Augmented Generation (RAG) comes in.

The Core Pattern

RAG is a two-step process:

  1. Retrieval: When a user asks a question, you first search through your external knowledge base (using vector search techniques you've learned) to find the most relevant documents or passages.

  2. Augmented Generation: You then feed these retrieved documents along with the user's question into the LLM, which generates a response grounded in that specific information.

An Analogy

Think of an LLM without RAG as a brilliant student taking a closed-book exam—they can only rely on what they've memorized. RAG transforms this into an open-book exam: the student can consult specific, relevant textbooks (retrieved documents) before answering, leading to more accurate and up-to-date responses.

Why RAG Matters

  • Factual grounding: Responses cite actual documents rather than hallucinating facts
  • Current information: Access data beyond the LLM's training cutoff date
  • Domain-specific knowledge: Incorporate proprietary or specialized information
  • Transparency: You can show users which sources informed the answer

Key Takeaway: RAG bridges the gap between LLMs' generative capabilities and the need for accurate, source-backed answers by combining vector search retrieval with prompted generation.