Course contentsShow
← AI Engineering
Lesson 329 of 1,8869. Retrieval-Augmented Generation (RAG) - BasicsFree lesson

The Knowledge Base in RAG

Defining what constitutes a knowledge base: documents, structured data, APIs, and how they're prepared for retrieval.

The Knowledge Base in RAG

What you'll learn: You'll understand what makes up a RAG knowledge base and how different data sources are prepared for retrieval.

What Is a Knowledge Base?

In RAG, the knowledge base is the collection of information your system searches through to find relevant context for the LLM. Think of it as a library the AI can consult—but instead of physically browsing shelves, it uses vector search to instantly find relevant passages.

A knowledge base isn't just one type of data. It can include:

  • Documents: PDFs, Word files, text files, web pages, research papers
  • Structured data: Database records, spreadsheets, JSON files
  • APIs: Real-time data sources that provide information on demand
  • Multimedia: Transcripts from audio/video, image descriptions

Preparing Data for Retrieval

Raw data isn't directly searchable. It must be prepared through several steps:

  1. Extraction: Pull text from documents, parse structured formats, or fetch API responses
  2. Chunking: Break large documents into smaller, meaningful segments (paragraphs, sections)
  3. Embedding: Convert each chunk into a vector representation
  4. Storage: Save vectors and their original text in a vector database with metadata

The Analogy

Imagine preparing books for a library. You don't just throw them on shelves randomly. You catalog them (metadata), create an index system (embeddings), and organize them by topic (vector similarity). When someone asks a question, the librarian (retriever) quickly finds relevant books using the catalog, then hands specific pages (chunks) to the reader (LLM).

Key Takeaway: The knowledge base in RAG is your searchable information repository—comprising documents, structured data, and APIs—that must be extracted, chunked, embedded, and stored before it can be retrieved.