Properties of Conditional Distributions
You'll learn: How conditional distributions behave mathematically, including their normalization property and how to compute conditional expectations and variances.
The Core Idea
When you condition on an event, you're essentially creating a new probability world restricted to that event. Just like ordinary distributions, conditional distributions must follow certain rules and have their own means and variances—but computed within this restricted world.
Think of it like examining only the players on a basketball team who are over 6 feet tall. The "conditional distribution" of weights among these tall players forms a valid distribution on its own, with its own average and spread.
Key Properties
1. Normalization
Every conditional distribution integrates (or sums) to 1 over its domain. For discrete variables:
For continuous:
This must hold for each fixed value of the conditioning variable.
2. Conditional Expectation
The conditional mean is the expected value computed using the conditional distribution:
3. Conditional Variance
The conditional variance measures spread within the conditioned world:
Like regular variance, it uses the same computational shortcut but with conditional expectations.
Key Takeaway: Conditional distributions are valid probability distributions themselves, satisfying normalization and possessing their own expectations and variances computed exclusively within the conditioned scenario.