Convolution Formula for Discrete RVs
What you'll learn: You'll learn how to use the convolution formula to find the exact probability mass function of the sum of two independent discrete random variables.
The Core Idea
When you add two independent discrete random variables X and Y together to get Z = X + Y, you might wonder: what's the PMF of Z? The convolution formula gives you the answer.
Think of it like this: Z equals some value z when X takes value k and Y takes value (z - k), for any valid k. Since X and Y are independent, we multiply their probabilities. But there are often many ways to reach the same sum z (like 5 = 0+5 = 1+4 = 2+3, etc.), so we must add up all these possibilities.
The Formula
For independent discrete random variables X and Y, the PMF of Z = X + Y is:
P(Z = z) = Σ P(X = k) · P(Y = z - k)
The sum is taken over all values k where both X = k and Y = z - k are possible.
Analogy
Imagine two people independently rolling dice. If you want to know the probability their total is 7, you count all the ways to make 7: (1,6), (2,5), (3,4), (4,3), (5,2), (6,1). Each pair's probability is the product of the individual probabilities, and you sum them all. That's convolution!
Why It Works
Independence lets us write P(X = k, Y = z - k) = P(X = k) · P(Y = z - k). The law of total probability then sums over all mutually exclusive ways to achieve Z = z.
Key Takeaway: The convolution formula computes P(Z = z) for the sum Z = X + Y by summing the products P(X = k)·P(Y = z - k) over all compatible values of k.