Course contentsShow
← Machine Learning and Deep Learning
Lesson 801 of 3,53819. PyTorch FundamentalsFree lesson

Understanding nn.Module: The Base Class for All Models

Learn how nn.Module provides the foundation for building neural networks in PyTorch with automatic parameter tracking.

Understanding nn.Module: The Base Class for All Models

What you'll learn: How nn.Module serves as the foundation for building all neural networks in PyTorch with built-in parameter management.

The Core Idea

Think of nn.Module as a blueprint or contract that every neural network model in PyTorch must follow. Just like every car has an engine, wheels, and steering—no matter the brand—every PyTorch model inherits from nn.Module to get essential capabilities automatically.

When you create a neural network by subclassing nn.Module, you gain powerful features:

  1. Automatic parameter tracking: Any nn.Parameter or sub-module you define gets automatically registered. This means PyTorch knows exactly which tensors need gradients and need to be updated during training.

  2. Hierarchy management: Your model can contain other nn.Module objects (like layers), creating a clean tree structure that PyTorch navigates automatically.

  3. State management: Built-in methods for switching between training and evaluation modes, moving models to different devices (CPU/GPU), and saving/loading weights.

The Pattern

Every nn.Module follows this structure:

  • Define learnable parameters in __init__()
  • Implement the forward() method to specify how data flows through your model
  • PyTorch handles the backward pass automatically through autograd

You never call forward() directly—you call the model itself like a function, which triggers forward() plus additional hooks and checks that nn.Module provides behind the scenes.

Key Takeaway: nn.Module is PyTorch's base class that gives your models automatic parameter tracking, gradient computation support, and essential utilities—making it the starting point for every neural network you build.