Course contentsShow
← Machine Learning and Deep Learning
Lesson 2598 of 3,53856. Few-Shot and Meta-LearningFree lesson

Triplet Networks and Triplet Loss

Learn how anchor-positive-negative triplets train embeddings to satisfy margin-based distance constraints.

Triplet Networks and Triplet Loss

What you'll learn: How triplet networks learn better embeddings by explicitly enforcing distance relationships between anchor, positive, and negative examples.

The Core Idea

While Siamese Networks compare pairs of examples (similar vs. dissimilar), Triplet Networks work with three inputs simultaneously:

  • Anchor: Your reference example
  • Positive: An example from the same class as the anchor
  • Negative: An example from a different class

The network learns to make the anchor embedding closer to the positive than to the negative by a specific safety margin.

Triplet Loss Formula

Triplet Loss enforces this relationship mathematically:

L = max(0, d(anchor, positive) - d(anchor, negative) + margin)

Where d() is a distance function (typically Euclidean). The loss says: "The distance from anchor to positive should be at least margin smaller than the distance from anchor to negative."

Why the Margin Matters

Without a margin, the network might make anchor-positive distance just slightly smaller than anchor-negative. The margin (e.g., 0.2 or 0.5) forces a clear separation in embedding space, creating more robust representations for few-shot scenarios.

Connection to Few-Shot Learning

In few-shot tasks with limited examples, you need embeddings where similar items cluster tightly and dissimilar items stay far apart. Triplet loss explicitly optimizes for this geometric property, making it ideal when you'll later use nearest-neighbor or prototype-based classification.

Key Takeaway: Triplet Networks train embeddings using anchor-positive-negative triplets with margin-based constraints, ensuring that similar examples are meaningfully closer than dissimilar ones in the learned embedding space.