Gold Label / Gold Standard
A reference answer treated as definitively correct — used to grade workers and AI alike.
Definition
Gold labels are reference outputs created by trusted experts and used as ground truth. They calibrate quality: workers whose outputs disagree with gold get retrained or removed. For SFT data, gold labels become training examples directly.
Examples
- A board-certified radiologist's reading of a CT scan
- A senior engineer's "correct" implementation of a function
Related terms
Evaluation (Eval)
Testing AI outputs against quality criteria — the largest single category of AI training work.
Rubric
The structured scoring guide workers use to evaluate AI outputs consistently.
Inter-Annotator Agreement (IAA)
How often two workers labeling the same item give the same answer — the metric that catches bad rubrics.
Looking for actual gigs that use Gold Label / Gold Standard? Browse all live listings or filter by $100+/hr.