Course contentsShow
← Machine Learning and Deep Learning
Lesson 128 of 3,5382. Machine Learning Mindset and Core ConceptsFree lesson

Self-Supervised Learning: Creating Labels from Data

Discover how to generate supervisory signals automatically from the data itself.

Self-Supervised Learning: Creating Labels from Data

What you'll learn: How to train models by generating supervision signals automatically from unlabeled data itself.

The Core Idea

Self-supervised learning is a clever trick: instead of requiring humans to label data, you hide part of your data and ask the model to predict it. The data becomes both the input and the target.

Think of it like a jigsaw puzzle. You have the complete picture (your unlabeled data), but you hide some pieces and challenge yourself to fill in the blanks. The hidden pieces become your "labels"—generated automatically, no human annotator needed.

How It Works

You start with unlabeled data—images, text, audio, anything. Then you design a pretext task: a clever way to create artificial labels:

  • Text example: Hide random words in a sentence and predict them. "The cat sat on the ___" → predict "mat"
  • Image example: Rotate an image randomly and predict the rotation angle (0°, 90°, 180°, 270°)
  • Video example: Shuffle frames and predict their correct order

The model learns useful patterns and representations while solving these self-created puzzles. Unlike unsupervised learning (which finds structure without any task), self-supervised learning creates a specific prediction objective—but without manual labels.

Why It Matters

Self-supervised learning bridges supervised and unsupervised approaches. You get the benefits of task-driven learning (like supervised methods) but without the expensive labeling process. The representations learned often transfer beautifully to downstream tasks where you do have labels.

Key Takeaway: Self-supervised learning transforms unlabeled data into a supervised learning problem by automatically generating labels from the data itself—hide part, predict part.