Designing Evaluation Rubrics
What you'll learn: How to create clear, repeatable scoring guidelines that help human annotators evaluate AI outputs consistently.
The Core Idea
A rubric is a structured scoring guide that breaks down "quality" into specific, measurable dimensions. Without rubrics, asking three people to rate an AI response as "good" or "bad" might yield three different answers. With a well-designed rubric, those same people should arrive at similar scores because they're using the same objective criteria.
Think of it like a restaurant health inspection checklist: instead of asking "Is this kitchen clean?" inspectors check specific items — "Are raw meats stored separately?" "Is the floor free of debris?" Each item has clear pass/fail criteria, so different inspectors reach consistent conclusions.
Key Components of an Effective Rubric
1. Clear Dimensions
Break evaluation into specific aspects you learned earlier: factuality, instruction following, tone, relevance, completeness. Don't lump everything into one "quality" score.
2. Explicit Criteria
For each dimension, define what different score levels mean in concrete terms:
- Poor (1): "Response contains factual errors" ← specific
- Not: "Response is bad" ← vague
3. Score Scale
Choose a scale (binary, 1-5, 1-10) based on your task. Fewer points reduce annotator confusion but capture less nuance.
4. Examples
Include sample outputs at each score level. Real examples anchor understanding better than descriptions alone.
5. Edge Case Guidance
Address common questions: "What if response is polite but wrong?" "How do I score partial answers?"
Key Takeaway: A well-designed rubric transforms subjective judgment into measurable, reproducible scores by giving annotators specific, dimension-based criteria with clear examples — reducing variability and making human evaluation reliable enough to trust.