Course contentsShow
← Machine Learning and Deep Learning
Lesson 2545 of 3,53855. Self-Supervised LearningFree lesson

Hard Negative Mining

Selecting challenging negative samples that are similar to positives to improve discriminative power of representations.

Hard Negative Mining

What you'll learn: How selecting the most challenging negative samples can dramatically improve the discriminative power of your learned representations in self-supervised learning.

The Problem with Random Negatives

In contrastive learning, you've been sampling random negative examples to push away from your anchor. But think about this: if you're learning to distinguish cats from dogs, which teaches you more—comparing a cat to a rock, or comparing a cat to a very dog-like cat? The latter is much harder and forces your model to learn finer distinctions.

Hard negative mining is the practice of deliberately selecting negative samples that are similar to your positive examples, rather than picking them randomly. These "hard negatives" are samples that look deceptively like positives but aren't—they're the ones your model might easily confuse.

Why Hard Negatives Matter

Imagine you're training a face recognition system. Random negatives might include images of cars, buildings, or completely different people. Your model learns these distinctions easily. But hard negatives—faces of people who look similar to your target person—force the model to learn subtle, discriminative features like the precise shape of the nose or the spacing between eyes.

In the InfoNCE loss you've learned, most random negatives contribute little to the gradient because they're already far apart in embedding space. Hard negatives, being closer to the anchor, provide stronger learning signals and improve the alignment and uniformity trade-off you studied earlier.

Implementation Strategy

You typically identify hard negatives by computing similarity scores and selecting those with the highest scores (closest to the anchor) from your negative set. This can be done per-batch or using a memory bank of embeddings.

Key Takeaway: Hard negative mining improves contrastive learning by focusing on challenging samples that are similar to positives, forcing the model to learn more discriminative representations instead of wasting capacity on trivial distinctions.