Orthogonality of Fundamental Subspaces
You'll learn how the four fundamental subspaces of a matrix pair up as orthogonal complements.
The Core Idea
When we studied the four fundamental subspaces—row space, column space, null space, and left null space—we saw them as separate entities. But there's a beautiful hidden structure: they come in orthogonal pairs.
Specifically:
- The row space and null space are orthogonal complements in ℝⁿ
- The column space and left null space are orthogonal complements in ℝᵐ
What does "orthogonal complements" mean? Two subspaces are orthogonal complements when every vector in one is perpendicular to every vector in the other, and together they span the entire space.
Why This Happens
Consider a matrix A with dimensions m × n.
For the null space: if Ax = 0, then each row of A dotted with x equals zero. This means x is perpendicular to every row! Since the row space is spanned by the rows, x is perpendicular to the entire row space.
Similarly, if Aᵀy = 0 (meaning y is in the left null space), then y is perpendicular to every column of A—hence perpendicular to the entire column space.
The Visual Picture
Think of ℝ³ split by a plane and its perpendicular line. The plane could be the row space (dimension 2), and the line through the origin perpendicular to it would be the null space (dimension 1). Together: 2 + 1 = 3, they fill the whole space, and they're completely orthogonal.
Key Takeaway: The row space and null space are orthogonal complements (as are the column space and left null space), meaning they're perpendicular and together span their ambient space—a fundamental geometric relationship in linear algebra.