HR & People Operations Expert

Build realistic HR and people operations evaluations

Create benchmark tasks that test whether AI systems can complete real HR and people operations work. Translate practical workflows into demanding assignments with clear reference materials and objective grading criteria. Prior AI experience is not required; the emphasis is on direct professional knowledge and sound judgment.

Responsibilities

• Design tasks involving payroll operations, workforce planning, policy application, and employee lifecycle processes, with multiple steps and enough context for a reviewer to evaluate the result.
• Write clear task instructions and prepare or source the supporting policy documents, payroll reports, headcount data, and employment agreements.
• Define grading criteria that let two qualified reviewers reach the same conclusion about the same output.
• Test the ability to interpret the supplied materials and make judgments, rather than simply retrieve information.
• Identify ambiguous tasks or outputs that cannot be graded reliably, and flag them instead of submitting them as finished work.
• Deliver approved tasks on schedule and meet the required quality standard.

Relevant experience

• At least five years of direct responsibility in payroll, workforce planning, HR policy, or employee lifecycle operations. Experience must include doing and owning the work, rather than only supervising it or working alongside it.
• Experience developing or applying structured standards such as HR policies, payroll checklists, process documentation, compliance frameworks, or training assessments.
• Comfort working across spreadsheets, reports, and policy documents. SHRM, CIPD, PHR, or equivalent certification is helpful but optional.
• Strong written and spoken English, with B2 as the minimum and C1 preferred.
• AI or large language model evaluation experience is welcome but is not a prerequisite.

Contract and selection

The contract is fully remote, with no geographic restrictions. Pay is up to $90 per hour equivalent, and a task is expected to take approximately ten hours.

Selection includes screening questions and an AI interview specific to this role, followed by onboarding. The interview presents your domain experience for the client's review. Applicants who have interviewed previously are still asked to complete the interview for this particular role, with a profile review before onboarding.