Independence and Functions of Random Variables
You'll learn: When two random variables are independent, any functions of them separately remain independent too.
The Core Idea
Suppose you've established that random variables X and Y are independent—meaning knowing one tells you nothing about the other. Here's a powerful consequence: if you apply any function g to X alone, and any function h to Y alone, the resulting random variables g(X) and h(Y) are also independent.
This makes intuitive sense. If X and Y have no relationship, transforming them individually shouldn't create one. For example, if a coin flip (X) is independent of a die roll (Y), then squaring the coin outcome and taking the logarithm of the die result produces independent quantities too.
Why This Matters
This property dramatically simplifies working with independent variables:
- Computing expectations: E[g(X)h(Y)] = E[g(X)] · E[h(Y)]
- Finding variances: Var(g(X) + h(Y)) = Var(g(X)) + Var(h(Y))
- Deriving distributions: You can analyze transformations without worrying about induced dependencies
An Analogy
Think of two separate factories on different continents. Factory X produces widgets, Factory Y produces gadgets. They operate independently—one doesn't influence the other. Now paint the widgets red (apply function g) and shrink the gadgets (apply function h). These operations happen within each factory. The painted widgets and shrunk gadgets remain independent—the modification process doesn't create a connection between factories.
Mathematical Statement
If X ⊥⊥ Y (X and Y are independent), then for any measurable functions g and h:
g(X) ⊥⊥ h(Y)
This follows because independence means P(X ∈ A, Y ∈ B) = P(X ∈ A)P(Y ∈ B) for all sets A and B, and this factorization is preserved under transformations.
Key Takeaway: Independence is preserved under functional transformations—if X and Y are independent, then g(X) and h(Y) are independent for any functions g and h applied separately.