Rubric

The structured scoring guide workers use to evaluate AI outputs consistently.

Definition

A rubric is the set of explicit criteria used to score AI responses. Good rubrics make worker outputs reproducible (different evaluators agree) and useful for training. Most evaluation gigs come with a project-specific rubric you must learn.

Examples

  • "Score 1-5 on factual accuracy. 5 = all facts verifiable. 1 = contains a hallucination."
  • A 3-axis scoring matrix: helpfulness × harmlessness × honesty

Related terms

Looking for actual gigs that use Rubric? Browse all live listings or filter by $100+/hr.