Course contentsShow
← Machine Learning and Deep Learning
Lesson 892 of 3,53821. CNN ArchitecturesFree lesson

VGGNet: Depth Through Simplicity

Study VGG's philosophy of stacking small 3×3 convolutions to build very deep networks (16-19 layers).

VGGNet: Depth Through Simplicity

What you'll learn: How VGGNet proved that going deeper with uniform, small convolutions could dramatically improve image classification performance.

The Core Philosophy

After AlexNet's breakthrough, researchers asked: what makes CNNs work better? VGGNet (2014) answered with radical simplicity: use only 3×3 convolutions, stack them deep, and repeat the pattern consistently.

Instead of mixing large kernels (11×11, 5×5) like AlexNet, VGGNet used exclusively 3×3 filters throughout the entire network. The insight? Two stacked 3×3 convolutions have the same receptive field as one 5×5 convolution, but with fewer parameters and more nonlinearities (ReLU activations) between them.

Why 3×3 Everywhere?

Think of building with LEGO blocks. You could use giant specialized pieces for each part, or use many small identical bricks. VGGNet chose the "small bricks" approach:

  • Smaller 3×3 kernels = fewer parameters per layer
  • Stacking multiple layers = same receptive field as larger kernels
  • More ReLU activations = increased nonlinearity and learning capacity

For example, three 3×3 convs achieve a 7×7 receptive field with 3×(3×3) = 27 parameters per output location, versus 49 for a single 7×7 filter.

Architecture Highlights

VGGNet came in variants (VGG-16, VGG-19) with 16-19 layers deep—much deeper than predecessors. The pattern was simple: stacks of conv layers followed by max pooling, doubling channels as spatial dimensions halved (64→128→256→512).

Key Takeaway: VGGNet demonstrated that network depth with small, uniform convolutions outperforms shallow networks with large kernels, establishing simplicity and depth as core design principles for modern CNNs.