Properties of Good Estimators
What You'll Learn
You'll learn the three fundamental criteria—unbiasedness, consistency, and efficiency—that statisticians use to judge whether a point estimator is truly reliable.
Why Properties Matter
When you estimate a population parameter from sample data, not all estimators are created equal. Some consistently hit close to the target; others might be systematically off or wildly unpredictable. To separate the good from the mediocre, we evaluate estimators on three key dimensions.
The Three Core Properties
Unbiasedness
An estimator is unbiased if its expected value equals the true parameter. Think of it like a dartboard: an unbiased estimator's throws center around the bullseye on average, with no systematic left or right lean.
Mathematically: An estimator θ̂ is unbiased for parameter θ if E[θ̂] = θ.
Example: The sample mean X̄ is an unbiased estimator of the population mean μ, because E[X̄] = μ.
Consistency
An estimator is consistent if it converges in probability to the true parameter as sample size grows. As you collect more data, a consistent estimator locks in on the correct value. This relates directly to the Law of Large Numbers you've studied.
Example: The sample mean becomes virtually certain to be near μ with large n.
Efficiency
Among unbiased estimators, the efficient one has the smallest variance—it produces the tightest cluster of estimates. Lower variance means less sampling variability and more precision.
Analogy: Two dart players both aim true (unbiased), but the efficient one has a tighter grouping.
Choosing the Best Estimator
Ideally, you want an estimator that's unbiased, consistent, and efficient. When trade-offs arise, statisticians weigh these criteria based on the situation.
Key Takeaway: Good estimators are unbiased (on-target on average), consistent (improve with more data), and efficient (minimal variance among unbiased options).