Rubric
The structured scoring guide workers use to evaluate AI outputs consistently.
Definition
A rubric is the set of explicit criteria used to score AI responses. Good rubrics make worker outputs reproducible (different evaluators agree) and useful for training. Most evaluation gigs come with a project-specific rubric you must learn.
Examples
- "Score 1-5 on factual accuracy. 5 = all facts verifiable. 1 = contains a hallucination."
- A 3-axis scoring matrix: helpfulness × harmlessness × honesty
Related terms
Looking for actual gigs that use Rubric? Browse all live listings or filter by $100+/hr.