Course contentsShow
← Mathematics
Lesson 1845 of 3,12139. Multivariable Functions and Partial DerivativesFree lesson

The Gradient Points in the Direction of Steepest Ascent

Prove and understand why the gradient vector points in the direction of maximum rate of increase.

The Gradient Points in the Direction of Steepest Ascent

What you'll learn: You'll discover why the gradient vector always points in the direction where a function increases most rapidly.

The Core Idea

Imagine you're hiking on a mountainside. At any point, you can walk in infinitely many directions. Some directions lead uphill gradually, others steeply, and some lead downhill. The gradient vector always points in the direction that climbs the mountain fastest.

Mathematically, recall that the directional derivative in direction u (a unit vector) is:

Duf=∇f⋅uD_{\mathbf{u}}f = \nabla f \cdot \mathbf{u}

This dot product equals ∥∇f∥∥u∥cos⁡θ=∥∇f∥cos⁡θ\|\nabla f\| \|\mathbf{u}\| \cos\theta = \|\nabla f\| \cos\theta (since u has length 1), where θ is the angle between ∇f and u.

Why the Gradient Wins

The dot product ∥∇f∥cos⁡θ\|\nabla f\| \cos\theta is maximized when cos⁡θ=1\cos\theta = 1, which happens when θ=0\theta = 0. This means u points in the same direction as ∇f.

In other words:

  • The rate of increase in any direction is ∥∇f∥cos⁡θ\|\nabla f\| \cos\theta
  • This rate is largest when you move parallel to ∇f
  • The maximum rate of increase is exactly ∥∇f∥\|\nabla f\|, the magnitude of the gradient itself

The Analogy

Think of the gradient as a compass that always points "uphill." The length of the gradient tells you how steep the climb is. If you deviate from this direction, cos⁡θ\cos\theta decreases, meaning you're climbing less steeply.

Conversely, the gradient points opposite to the direction of steepest descent (the negative gradient, −∇f).

Key Takeaway: The gradient ∇f points in the direction of maximum rate of increase, and its magnitude ∥∇f∥\|\nabla f\| gives that maximum rate.