Moment Generating Functions (MGFs)
What You'll Learn
You'll discover a powerful tool that captures all moments of a probability distribution in a single, elegant function.
The Core Idea
A Moment Generating Function (MGF) is a special function that encodes information about all moments (mean, variance, skewness, kurtosis, and beyond) of a random variable into one compact formula.
For a random variable X, the MGF is defined as:
M_X(t) = E[e^(tX)]
where t is a real parameter. In other words, it's the expectation of e raised to the power tX.
For discrete random variables: M_X(t) = Σ e^(tx) · P(X = x)
For continuous random variables: M_X(t) = ∫ e^(tx) · f_X(x) dx
Why "Moment Generating"?
The magic happens when you take derivatives. The n-th derivative of M_X(t) evaluated at t = 0 gives you the n-th moment E[X^n]:
- M_X(0) = E[e^0] = 1
- M'_X(0) = E[X] (the mean!)
- M''_X(0) = E[X²] (used for variance!)
- M'''_X(0) = E[X³] (used for skewness!)
It's like having a complete "blueprint" of your distribution's behavior.
Basic Properties
- Uniqueness: If two random variables have the same MGF, they have the same distribution
- Scaling: M_(aX)(t) = M_X(at)
- Translation: M_(X+b)(t) = e^(bt) · M_X(t)
- Independence: For independent X and Y, M_(X+Y)(t) = M_X(t) · M_Y(t)
Key Takeaway: The MGF M_X(t) = E[e^(tX)] encodes all moments of a distribution and can be differentiated to extract E[X^n], making it an invaluable tool for analyzing random variables.