Preference Data

Pairs of AI outputs labeled "A is better than B" — the raw fuel for RLHF.

Definition

Preference data is the dataset of human-labeled comparisons used to train reward models. Workers see two AI-generated responses to the same prompt and pick the better one (or rank a list). This is the dominant gig type in 2026 AI training — high-volume, well-paid, requires careful judgment.

Examples

  • You see two answers to "Explain quantum entanglement to a 12-year-old" and pick the clearer one
  • You rank 4 code snippets from best to worst

Related terms

Looking for actual gigs that use Preference Data? Browse all live listings or filter by $100+/hr.