Course contentsShow
← Machine Learning and Deep Learning
Lesson 1980 of 3,53842. Retrieval-Augmented Generation: FoundationsFree lesson

Multilingual Embedding Models

Understand how models like mBERT and LaBSE enable cross-lingual retrieval by aligning embeddings across languages.

Multilingual Embedding Models

What You'll Learn

You'll understand how multilingual embedding models enable cross-lingual retrieval by mapping text from different languages into a shared semantic space.

The Core Challenge

Imagine you have documents in English, Spanish, and Japanese, but users might query in any of these languages. Traditional embedding models trained on English can't naturally handle this—each language lives in its own isolated vector space.

Multilingual embedding models solve this by creating a universal semantic space where sentences with the same meaning land close together, regardless of which language they're written in.

How They Work

Models like mBERT (multilingual BERT) and LaBSE (Language-agnostic BERT Sentence Embedding) achieve cross-lingual alignment through:

  1. Training on parallel data: Sentence pairs that mean the same thing across languages
  2. Contrastive learning: Pulling together embeddings of equivalent sentences while pushing apart unrelated ones
  3. Shared vocabulary: Using subword tokenization (like WordPiece) that captures patterns across scripts

Think of it like a universal translator that doesn't translate words—it translates meaning into numbers. "Hello world" in English and "Hola mundo" in Spanish both map to nearby points in vector space.

Why This Matters for RAG

In a multilingual RAG system, you can:

  • Index documents in multiple languages once
  • Retrieve relevant chunks regardless of query language
  • Enable true cross-lingual search: query in French, retrieve German documents

The embedding model handles the heavy lifting of semantic alignment, so your vector database and retrieval pipeline work seamlessly across languages without translation steps.

Key Takeaway: Multilingual embedding models like mBERT and LaBSE enable cross-lingual retrieval by aligning semantically similar text from different languages in a shared vector space, allowing RAG systems to work naturally across language boundaries.