Expectation of the Geometric Distribution
What you'll learn: You'll prove that for a geometric random variable modeling the number of trials until the first success, the expected value is E[X] = 1/p, using infinite series techniques.
The Core Idea
Recall that the geometric distribution models the number of trials needed to get the first success in a sequence of independent Bernoulli trials, each with success probability p. Intuitively, if success is very likely (p close to 1), we expect to succeed quickly. If p is small, we'll need many tries on average.
The PMF is P(X = k) = (1-p)^(k-1) · p for k = 1, 2, 3, ...
The Proof
By definition:
E[X] = Σ(k=1 to ∞) k · P(X = k) = Σ(k=1 to ∞) k · (1-p)^(k-1) · p
Factor out p:
E[X] = p · Σ(k=1 to ∞) k · (1-p)^(k-1)
Let q = 1-p. We need to evaluate Σ(k=1 to ∞) k · q^(k-1).
Key series technique: Recall that the geometric series gives us:
Σ(k=0 to ∞) q^k = 1/(1-q) for |q| < 1
Taking the derivative with respect to q:
Σ(k=1 to ∞) k · q^(k-1) = d/dq [1/(1-q)] = 1/(1-q)²
Substituting back (1-q) = p:
E[X] = p · 1/p² = 1/p
Intuitive Check
If p = 1/2 (fair coin), E[X] = 2 flips on average. If p = 1/10, E[X] = 10 trials. Makes sense!
Key Takeaway: The expected number of trials until the first success in a geometric distribution is E[X] = 1/p, proven by differentiating the geometric series formula.