Variance of Sums: Independent Case
What You'll Learn
You'll learn to prove that when two random variables are independent, the variance of their sum equals the sum of their variances.
The Core Idea
When you add two independent random variables together, how does the variance behave? It turns out that independence makes variances add nicely: Var(X + Y) = Var(X) + Var(Y).
This is remarkable because we already know that expectations always add linearly (whether variables are independent or not), but variance—which measures spread—only adds this cleanly when there's no relationship between the variables.
The Proof
Let's prove this step by step using what we've learned.
Start with the definition:
Var(X + Y) = E[(X + Y)²] - [E(X + Y)]²
Expand the square:
E[(X + Y)²] = E[X² + 2XY + Y²]
= E[X²] + 2E[XY] + E[Y²]
And expand the squared expectation:
[E(X + Y)]² = [E(X) + E(Y)]²
= [E(X)]² + 2E(X)E(Y) + [E(Y)]²
Substituting back:
Var(X + Y) = E[X²] + 2E[XY] + E[Y²] - [E(X)]² - 2E(X)E(Y) - [E(Y)]²
Rearrange by grouping X and Y terms:
= [E[X²] - [E(X)]²] + [E[Y²] - [E(Y)]²] + 2[E[XY] - E(X)E(Y)]
= Var(X) + Var(Y) + 2[E[XY] - E(X)E(Y)]
Here's where independence matters! For independent random variables, E[XY] = E[X]E[Y], so that final term equals zero:
Var(X + Y) = Var(X) + Var(Y)
Analogy
Think of variance as the "wiggle room" in a measurement. If two measurements are independent (one doesn't influence the other), their combined uncertainty is the sum of individual uncertainties.
Key Takeaway: For independent random variables X and Y, variances add: Var(X + Y) = Var(X) + Var(Y). The independence assumption is crucial—it eliminates the cross-term involving E[XY].