Evaluation (Eval)

Testing AI outputs against quality criteria — the largest single category of AI training work.

Definition

Evaluation work measures whether an AI response meets a standard: factual accuracy, safety, helpfulness, format compliance, etc. Contractors apply rubrics to rate outputs. This is the entry-level door into AI training; pay scales with rubric complexity and domain expertise.

Examples

  • Rating a code answer 1-5 on correctness, efficiency, and clarity
  • Flagging hallucinated facts in a summary
  • Scoring whether the AI followed format instructions

Related terms

Looking for actual gigs that use Evaluation (Eval)? Browse all live listings or filter by $100+/hr.