Pythagorean Theorem in Inner Product Spaces
What you'll learn: You'll see how the familiar Pythagorean theorem extends beautifully to any inner product space when vectors are orthogonal.
The Core Idea
You know the Pythagorean theorem from geometry: for a right triangle with legs a and b and hypotenuse c, we have a² + b² = c². In inner product spaces, this theorem generalizes to orthogonal vectors.
If two vectors u and v are orthogonal (meaning ⟨u, v⟩ = 0), then their "sum" behaves just like adding perpendicular sides of a triangle. The squared norm (length) of their sum equals the sum of their squared norms:
‖u + v‖² = ‖u‖² + ‖v‖²
Why It Works
Let's verify this using properties you already know. Expand ‖u + v‖² using the inner product definition of norm:
‖u + v‖² = ⟨u + v, u + v⟩
Using linearity of the inner product:
= ⟨u, u⟩ + ⟨u, v⟩ + ⟨v, u⟩ + ⟨v, v⟩
Since u ⊥ v, we have ⟨u, v⟩ = 0 and ⟨v, u⟩ = 0:
= ⟨u, u⟩ + ⟨v, v⟩ = ‖u‖² + ‖v‖²
This holds in any inner product space: ℝⁿ, ℂⁿ, or even function spaces! For example, if two functions are orthogonal under an appropriate inner product, their "combined energy" (norm squared) is the sum of their individual energies.
An Intuitive Analogy
Think of orthogonal vectors as independent components with no overlap—like walking 3 meters east, then 4 meters north. Your total distance from start is 5 meters (3² + 4² = 5²), not 7 meters, because the motions are perpendicular.
Key Takeaway: In any inner product space, orthogonal vectors satisfy the Pythagorean theorem: ‖u + v‖² = ‖u‖² + ‖v‖² when ⟨u, v⟩ = 0.