Introduction to Probability Density Functions (PDFs)
What you'll learn: You'll discover how probability works for continuous random variables through the concept of density rather than individual point probabilities.
The Challenge with Continuous Random Variables
Remember that discrete random variables use probability mass functions (PMFs) to assign probabilities to specific values. But with continuous random variables—like exact heights, temperatures, or times—we hit a problem: there are infinitely many possible values in any interval, making the probability of hitting any single exact value essentially zero!
Understanding Probability Density
Instead of asking "What's the probability of exactly 5.0000...?" we ask "What's the probability of being near 5?" or "between 4.9 and 5.1?"
A probability density function (PDF), denoted f(x), describes how probability is "distributed" across the range of a continuous random variable X. Think of it like this:
- PMF analogy: Height of bars tells you exact probabilities
- PDF analogy: Height of a smooth curve tells you density—where probability is concentrated
The key difference: density is not probability itself. Just like physical density (mass per volume), probability density tells you "probability per unit length." To find actual probability, you need to consider an interval.
How Density Relates to Probability
The probability that X falls in an interval [a, b] equals the area under the PDF curve between a and b. Mathematically, this is an integral:
P(a ≤ X ≤ b) = ∫[from a to b] f(x) dx
The taller the PDF at a point, the more "dense" the probability is there—making nearby intervals more likely.
Key Takeaway: For continuous random variables, the PDF f(x) represents probability density (not probability itself), and probabilities are found by computing areas under the density curve over intervals.