Properties of Independent Random Variables
What You'll Learn
You'll discover two fundamental properties that make independent random variables especially powerful: how their expectations multiply and how their variances add.
The Core Idea
When two random variables X and Y are independent, they behave in predictable ways when combined:
Property 1: Expectation of a Product
For independent random variables:
E[XY] = E[X] · E[Y]
Think of this like investing in two completely unrelated markets. Your expected combined return is simply the product of each individual expected return. Independence means knowing the outcome of X tells you nothing about Y, so their expectations "decouple."
Note: This property only holds when X and Y are independent. For dependent variables, E[XY] ≠ E[X]·E[Y] in general.
Property 2: Variance of a Sum
For independent random variables:
Var(X + Y) = Var(X) + Var(Y)
Imagine two dice rolled separately versus a single outcome. Since the dice don't influence each other, the total unpredictability (variance) of their sum is just the sum of their individual variances. Independence means the variables don't "conspire" to move together, so there's no covariance term to worry about.
Extension: For any constants a and b:
- Var(aX + bY) = a²Var(X) + b²Var(Y)
Why This Matters
These properties dramatically simplify calculations. For example, if you have n independent identically distributed variables X₁, X₂, ..., Xₙ, then Var(X₁ + X₂ + ... + Xₙ) = nVar(X₁). This underlies much of statistical theory, from the binomial distribution to the central limit theorem.
Key Takeaway: When random variables are independent, expectations multiply for products (E[XY] = E[X]E[Y]) and variances add for sums (Var(X+Y) = Var(X) + Var(Y)).