The Prior Distribution
You'll learn how to formally represent what you believe before seeing the data — the starting point of every Bayesian analysis.
What Is a Prior Distribution?
In Bayesian statistics, the prior distribution quantifies your beliefs about a parameter before you observe any data. Remember Bayes' Theorem? The prior is the P(θ) term — it captures everything you know (or assume) about θ going into the analysis.
Think of it like this: if you're estimating a website's conversion rate, you might believe it's somewhere between 2% and 8% based on industry benchmarks, past experience, or domain knowledge. The prior distribution is how you encode that belief mathematically.
Types of Priors
Informative priors reflect strong beliefs. If you've run 50 similar experiments, you might use a tight prior centered around 5% conversion.
Weakly informative priors gently guide the analysis away from unrealistic values (like 99% conversion) without imposing strong opinions.
Non-informative (flat) priors essentially say "I know nothing" — they let the data dominate the analysis completely.
Choosing Your Prior
Your choice matters! A strong prior can stabilize estimates when data is scarce but may bias results if misspecified. Consider:
- Historical data: Previous experiments or studies
- Domain expertise: What do experts believe is plausible?
- Mathematical convenience: Some priors (called conjugate priors) make calculations simpler
- Sensitivity: Test multiple priors to see if conclusions change
Key Takeaway: The prior distribution formalizes your initial beliefs about a parameter before data collection; it should balance domain knowledge, mathematical tractability, and openness to learning from new evidence.