Evaluation (Eval)
Testing AI outputs against quality criteria — the largest single category of AI training work.
Definition
Evaluation work measures whether an AI response meets a standard: factual accuracy, safety, helpfulness, format compliance, etc. Contractors apply rubrics to rate outputs. This is the entry-level door into AI training; pay scales with rubric complexity and domain expertise.
Examples
- Rating a code answer 1-5 on correctness, efficiency, and clarity
- Flagging hallucinated facts in a summary
- Scoring whether the AI followed format instructions
Related terms
Rubric
The structured scoring guide workers use to evaluate AI outputs consistently.
Red Teaming
Adversarially probing AI for safety failures — getting it to produce harmful, biased, or dangerous outputs.
Gold Label / Gold Standard
A reference answer treated as definitively correct — used to grade workers and AI alike.
Looking for actual gigs that use Evaluation (Eval)? Browse all live listings or filter by $100+/hr.