Course contentsShow
← Mathematics
Lesson 2960 of 3,12158. Joint and Limit BehaviorFree lesson

Moment Generating Functions: Definition

Understand the definition and basic properties of moment generating functions (MGFs).

Moment Generating Functions: Definition

You'll learn what a moment generating function is and why it's a powerful tool for characterizing random variables.

What Is a Moment Generating Function?

A moment generating function (MGF) is a special function associated with a random variable that "encodes" all of its moments (expected values of powers). For a random variable X, the MGF is defined as:

MX(t)=E[etX]M_X(t) = E[e^{tX}]

where t is a real number parameter.

In plain English: the MGF is the expected value of e raised to the power tX. Think of it as a "fingerprint" for the distribution—different distributions have different MGFs.

Breaking Down the Definition

  • For discrete X: MX(t)=∑xetx⋅P(X=x)M_X(t) = \sum_x e^{tx} \cdot P(X = x)
  • For continuous X: MX(t)=∫−∞∞etx⋅fX(x) dxM_X(t) = \int_{-\infty}^{\infty} e^{tx} \cdot f_X(x) \, dx

The MGF exists only if this expectation is finite for t in some interval around zero (say, −h<t<h-h < t < h for some h>0h > 0).

Why "Moment Generating"?

The name comes from its ability to generate moments. If you take derivatives of MX(t)M_X(t) with respect to t and evaluate at t=0t = 0, you get the moments:

  • MX′(0)=E[X]M_X'(0) = E[X] (first moment = mean)
  • MX′′(0)=E[X2]M_X''(0) = E[X^2] (second moment)
  • MX(n)(0)=E[Xn]M_X^{(n)}(0) = E[X^n] (nth moment)

It's like having a single function that contains the DNA of all the distribution's moments!

Key Takeaway: The moment generating function MX(t)=E[etX]M_X(t) = E[e^{tX}] uniquely characterizes a distribution and provides a compact way to compute all moments through differentiation.