Course contentsShow
← Machine Learning and Deep Learning
Lesson 2572 of 3,53855. Self-Supervised LearningFree lesson

Random Patch Masking Strategies

How to select which image patches to mask: random, block-wise, and adaptive strategies.

Random Patch Masking Strategies

What you'll learn: How to choose which parts of an image to hide when training self-supervised vision models through masking.

The Core Idea

In masked image modeling (which you just learned about), the model learns by predicting hidden patches of an image. But which patches should you mask? This seemingly simple choice dramatically affects what your model learns and how efficiently it trains.

Think of it like studying for an exam: should you randomly skip words while reading (random masking), black out entire paragraphs (block-wise), or focus on the hardest sections (adaptive)? Each strategy teaches you differently.

Three Main Strategies

Random Masking

The simplest approach: independently select each patch with some probability (e.g., 75%). Every patch has an equal chance of being masked, creating scattered "holes" across the image. This forces the model to use context from all directions and prevents it from exploiting spatial locality too much.

Block-Wise Masking

Instead of scattering individual patches, mask contiguous rectangular blocks. This is harder because neighboring patches can't help each other—the model must use longer-range context. It's like removing entire objects from a scene rather than random pixels.

Adaptive Masking

Intelligently choose patches based on content: mask regions with high information density, edges, or texture. This targets the most challenging parts, potentially speeding up learning. However, it adds computational overhead to determine what to mask.

Practical Considerations

Random masking is most common because it's simple and effective. Block-wise masking can improve robustness but may need longer training. Adaptive strategies are less explored but promising for difficult domains.

The masking ratio (typically 50-75%) matters as much as the strategy—too little and the task is trivial, too much and it becomes impossible.

Key Takeaway: Random patch masking strategies determine which image regions to hide during training; random masking is simplest and most common, block-wise increases difficulty through spatial coherence, and adaptive masking targets informative regions.