Business Operations Expert

Build realistic business operations evaluations

Create benchmark tasks that test whether AI systems can complete real business operations work. Translate practical workflows into demanding assignments with clear reference materials and objective grading criteria. Prior AI experience is not required; the emphasis is on direct professional knowledge and sound judgment.

Responsibilities

• Design tasks involving reporting, process design, and workflow management, with multiple steps and enough context for a reviewer to evaluate the result.
• Write clear task instructions and prepare or source the supporting spreadsheets, system exports, process documentation, and operational reports.
• Define grading criteria that let two qualified reviewers reach the same conclusion about the same output.
• Test the ability to interpret the supplied materials and make judgments, rather than simply retrieve information.
• Identify ambiguous tasks or outputs that cannot be graded reliably, and flag them instead of submitting them as finished work.
• Deliver approved tasks on schedule and meet the required quality standard.

Relevant experience

• At least five years of direct responsibility in business operations, operations reporting, process design, or workflow management. Experience must include doing and owning the work, rather than only supervising it or working alongside it.
• Experience developing or applying structured standards such as SOPs, QA checklists, process documentation, service level definitions, or training assessments.
• Strong Excel skills and the ability to reason across several documents at once.
• Strong written and spoken English, with B2 as the minimum and C1 preferred.
• AI or large language model evaluation experience is welcome but is not a prerequisite.

Contract and selection

The contract is fully remote, with no geographic restrictions. Pay is up to $90 per hour equivalent, and a task is expected to take approximately ten hours.

Selection includes screening questions and an AI interview specific to this role, followed by onboarding. The interview presents your domain experience for the client's review.