Orthogonal Complement and Direct Sum Decomposition
What You'll Learn
You'll learn how every vector in a space can be uniquely split into two perpendicular pieces: one living in a subspace and one living in its orthogonal complement.
The Core Idea
Imagine you're standing on a floor (a subspace) inside a room (the full vector space). Any object floating in the room can be described by two measurements: how far it is directly above the floor, and where it would land if dropped straight down. These two pieces are perpendicular, and together they completely describe the object's position.
Mathematically, given a subspace W of an inner product space V, every vector v in V can be written uniquely as:
v = w + w⊥
where:
- w is in W (the projection of v onto W)
- w⊥ is in W⊥ (the orthogonal complement of W)
- w and w⊥ are orthogonal to each other
This is called a direct sum decomposition, written as V = W ⊕ W⊥.
The word "direct" means the decomposition is unique—there's only one way to split v into these two components. The projection matrix P you've learned computes the w part, while (I - P) computes the w⊥ part.
Why It Matters
This decomposition is fundamental because it tells you that understanding a subspace and its orthogonal complement gives you a complete picture of the entire space. Nothing is left out, and nothing overlaps (except the zero vector).
Key Takeaway: Every vector uniquely decomposes as the sum of its projection onto a subspace and its projection onto the orthogonal complement, giving V = W ⊕ W⊥.