Bases for Important Subspaces
You'll learn how to find bases for the four fundamental subspaces of a matrix and understand how their dimensions relate.
The Four Fundamental Subspaces
Every matrix A (m × n) gives rise to four crucial subspaces that reveal its complete structure:
- Column Space (C(A)): All linear combinations of A's columns; lives in ℝᵐ
- Null Space (N(A)): All vectors x where Ax = 0; lives in ℝⁿ
- Row Space (C(Aᵀ)): All linear combinations of A's rows; lives in ℝⁿ
- Left Null Space (N(Aᵀ)): All vectors y where Aᵀy = 0; lives in ℝᵐ
Finding the Bases
Column Space: Row-reduce A to echelon form and identify pivot columns. The original columns corresponding to those pivots form a basis for C(A).
Null Space: Solve Ax = 0 completely. Express the solution in parametric form; the coefficient vectors of your free variables form a basis for N(A).
Row Space: The nonzero rows of the row-reduced form of A give you a basis for C(Aᵀ).
Left Null Space: Row-reduce the augmented matrix [A | I] until the left side becomes [R | E]. The rows of E corresponding to zero rows in R form a basis for N(Aᵀ).
Dimension Relationships
The dimensions tell a beautiful story:
- dim(C(A)) = rank(A) = r
- dim(N(A)) = n - r (from the Rank-Nullity Theorem!)
- dim(C(Aᵀ)) = r (same as column space)
- dim(N(Aᵀ)) = m - r
Notice: dim(C(A)) + dim(N(Aᵀ)) = m, and dim(C(Aᵀ)) + dim(N(A)) = n.
Key Takeaway: The four fundamental subspaces, with their bases and dimensions, completely characterize a matrix's linear transformation—what it maps, what it kills, and how each piece relates through the rank.