Linear Dependence and Redundant Vectors
What You'll Learn
You'll learn how to recognize when a set of vectors contains "redundant" information—meaning at least one vector can be expressed as a linear combination of the others.
The Core Idea
Recall that a set of vectors is linearly independent if no vector in the set can be written as a linear combination of the others. When this condition fails, we say the vectors are linearly dependent.
Linear dependence means there's redundancy: at least one vector doesn't add new directional information because it already lies in the span of the others.
Recognizing Linear Dependence
A set of vectors {v₁, v₂, ..., vₙ} is linearly dependent if you can find scalars c₁, c₂, ..., cₙ (not all zero) such that:
c₁v₁ + c₂v₂ + ... + cₙvₙ = 0
If such non-trivial coefficients exist, at least one vector is redundant.
Identifying the Redundant Vector
When vectors are linearly dependent, you can usually isolate one vector and express it in terms of the others. For example, if:
2v₁ - 3v₂ + v₃ = 0
Then solving for v₃:
v₃ = -2v₁ + 3v₂
This shows v₃ is redundant—it's already in the span of {v₁, v₂}.
Visual Analogy
Think of building a structure with rods. If three rods all lie in the same plane (or worse, the same line), one is redundant—it doesn't help you reach any new direction in space. Linearly dependent vectors are like those redundant rods.
Practical Signs of Dependence
- Two vectors are dependent if one is a scalar multiple of the other
- Three vectors in R² are always dependent (you can't have three independent directions on a flat plane)
- If any vector is the zero vector, the set is dependent
Key Takeaway: A set of vectors is linearly dependent when at least one vector can be written as a linear combination of the others, making it redundant and adding no new span.