Course contentsShow
← Mathematics
Lesson 2948 of 3,12158. Joint and Limit BehaviorFree lesson

Computing Covariance from Joint Distributions

Calculate covariance using joint probability mass or density functions for discrete and continuous variables.

Computing Covariance from Joint Distributions

You'll learn how to calculate covariance directly from the joint probability distribution of two random variables.

Core Idea

Covariance measures how two random variables vary together. While you've already seen its definition as ( \text{Cov}(X, Y) = E[(X - \mu_X)(Y - \mu_Y)] ), computing it from joint distributions requires integrating (or summing) over all possible pairs of values, weighted by their joint probabilities.

For Discrete Random Variables

When (X) and (Y) are discrete with joint PMF (p_{X,Y}(x, y)):

Cov(X,Y)=∑x∑y(x−μX)(y−μY)⋅pX,Y(x,y)\text{Cov}(X, Y) = \sum_x \sum_y (x - \mu_X)(y - \mu_Y) \cdot p_{X,Y}(x, y)

Or, using the computational shortcut:

Cov(X,Y)=E[XY]−E[X]E[Y]=∑x∑yxy⋅pX,Y(x,y)−μXμY\text{Cov}(X, Y) = E[XY] - E[X]E[Y] = \sum_x \sum_y xy \cdot p_{X,Y}(x, y) - \mu_X \mu_Y

Think of it as: For each possible outcome pair ((x, y)), you measure how far each is from its mean, multiply those deviations together, weight by the joint probability, and sum everything up.

For Continuous Random Variables

When (X) and (Y) are continuous with joint PDF (f_{X,Y}(x, y)):

Cov(X,Y)=∫−∞∞∫−∞∞(x−μX)(y−μY)⋅fX,Y(x,y) dx dy\text{Cov}(X, Y) = \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} (x - \mu_X)(y - \mu_Y) \cdot f_{X,Y}(x, y) \, dx \, dy

Or using the shortcut:

Cov(X,Y)=∫−∞∞∫−∞∞xy⋅fX,Y(x,y) dx dy−μXμY\text{Cov}(X, Y) = \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} xy \cdot f_{X,Y}(x, y) \, dx \, dy - \mu_X \mu_Y

The continuous case replaces sums with integrals, but the logic is identical.

Key Takeaway: Covariance is computed from joint distributions by summing (discrete) or integrating (continuous) the product of deviations or using (E[XY] - E[X]E[Y]), where (E[XY]) comes directly from the joint distribution.