Variance of Sums and Covariance
You'll learn how the variance of a sum of random variables depends on both individual variances and covariances.
The Core Idea
When you add random variables together, their variance doesn't simply add up—unless they're independent. The general formula accounts for how the variables co-vary together.
For two random variables X and Y:
Var(X + Y) = Var(X) + Var(Y) + 2Cov(X, Y)
Notice that extra term! If X and Y tend to move together (positive covariance), the sum is more variable than you'd expect. If they move oppositely (negative covariance), the sum is less variable—this is the principle behind diversification in finance.
Why This Works
Start from the definition of variance:
Var(X + Y) = E[(X + Y - E[X + Y])²]
Expanding the square and using linearity of expectation:
= E[(X - E[X])² + (Y - E[Y])² + 2(X - E[X])(Y - E[Y])]
= E[(X - E[X])²] + E[(Y - E[Y])²] + 2E[(X - E[X])(Y - E[Y])]
= Var(X) + Var(Y) + 2Cov(X, Y)
Extension to Multiple Variables
For any random variables X₁, X₂, ..., Xₙ:
Var(X₁ + X₂ + ... + Xₙ) = Σᵢ Var(Xᵢ) + 2Σᵢ<ⱼ Cov(Xᵢ, Xⱼ)
The variance includes all individual variances plus twice every pairwise covariance. When all variables are independent, all covariances are zero, and we recover the simpler formula you've seen before.
Key Takeaway: The variance of a sum equals the sum of individual variances plus twice the sum of all pairwise covariances; covariance captures how variables jointly contribute to total variability.