← Back to Gigs
AI Evaluation
$100 - $150 per hour

Data Scientist Talent Network

Apply Now → →

SignalGigs may earn a referral fee if you apply through this link.

Description

Network purpose

This network is for potential future projects that evaluate how effectively AI systems perform real-world data science work. There is no immediate opening, but qualified data scientists may be contacted when a relevant project becomes available.

Potential responsibilities

  • Design precise grading criteria for exploratory analysis, statistical models, machine-learning pipelines, experiments, A/B-test write-ups, feature engineering, notebooks, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria.
  • Provide detailed written justification for scores and evaluation decisions.
  • Apply evidence-based judgment consistently so results are reproducible and defensible.
  • Incorporate structured reviewer feedback and revise submitted work.
  • Adapt to project-specific responsibilities as assignments vary.

Relevant background

  • 1+ years of professional data science experience.
  • Experience at a strong technology, research, or quantitative organization.
  • Strong command of Python, SQL, statistical modeling, machine learning, experimentation, and causal inference.
  • Ability to turn messy real-world data into rigorous analysis.
  • Clear technical writing, close attention to detail, and consistent judgment.
  • Comfort calibrating decisions against established standards.

Details

Hiring company

Mercor

Category

AI Evaluation

Location

Remote

Posted

Interested? You'll apply on the hiring company's own site.

Apply Now →

SignalGigs may earn a referral fee if you apply through this link.

Join the job-alert list

Alerts are not being sent yet.

Pay Data

How Much Do AI Jobs Pay?

→
Guide

How to Get Started

→
Data Scientist Talent Network
$100 - $150 per hour
Apply Now → →