The Four Fundamental Subspaces
What you'll learn: How to identify and relate the four fundamental subspaces associated with any matrix, understanding their dimensions and ambient spaces.
The Big Picture
Every m × n matrix A generates exactly four subspaces that together reveal the complete structure of the matrix. These "fundamental subspaces" come in two pairs, and understanding them is key to mastering linear systems and transformations.
The Four Subspaces
For an m × n matrix A with rank r:
1. Column Space, C(A)
- Lives in R^m (the output space)
- Dimension: r (the rank)
- Spanned by the pivot columns of A
2. Null Space, N(A)
- Lives in R^n (the input space)
- Dimension: n - r (number of free variables)
- All vectors x where Ax = 0
3. Row Space, C(A^T)
- Lives in R^n (the input space)
- Dimension: r (same rank!)
- Spanned by the nonzero rows of the row echelon form
4. Left Null Space, N(A^T)
- Lives in R^m (the output space)
- Dimension: m - r
- All vectors y where A^Ty = 0
How They Connect
Think of the column space and row space as the "action" subspaces (dimension r each), while the null spaces capture what gets "killed" by the matrix. Notice the dimensions always add up: r + (n - r) = n in R^n, and r + (m - r) = m in R^m.
The row space and null space are orthogonal complements in R^n, as are the column space and left null space in R^m.
Key Takeaway: The four fundamental subspaces—column space (dim r in R^m), null space (dim n-r in R^n), row space (dim r in R^n), and left null space (dim m-r in R^m)—completely characterize a matrix's structure and satisfy the rank-nullity theorem in both input and output spaces.