Subject Matter Expert – Qualtative/Scientific/Corporate (English/Mandarin) – Remote

Benchmark AI against real professional work

Help develop AI evaluations focused on specific professional domains. The role combines technical subject expertise, local language fluency, and a detailed understanding of how work happens in the relevant field.

Candidates need demonstrated professional or academic exposure in at least one of these areas:

• Technical and quantitative work, including software engineering, mathematics, or robotics.
• Scientific and regulatory work, including healthcare clinical parameters, chemistry or physics datasets, and manufacturing systems, CAD, or optimization.
• Corporate and creative work, including finance, media and content, or office and white collar activities.

Technical and evaluation work

You must be able to understand code, refactor it, and verify its execution within a sandboxed environment. That technical ability is needed alongside contextual knowledge of the professional domain.

• Design realistic scenarios in the target language or in English, grounded in actual operating contexts.
• Adapt structured rubrics for evaluating the work.
• Review responses from AI and people for factual accuracy, quality, cultural fit, and practical realism.
• Contribute reference solutions that represent good practice for the relevant location and domain.

Qualifications

Native level proficiency in the target language and strong professional English are required. You also need at least five years of professional experience in the domain, a relevant occupational background, and a thorough understanding of its workflows and working environments.

Engagement and onboarding

The independent contractor arrangement allows you to choose your schedule and how much work to take on, without fixed hours or routine check ins. The arrangement includes prompt payments and access to varied projects through an international community of language and subject specialists.

To begin, provide an English CV emphasizing your domain experience. Complete registration with the payment service, then finish onboarding before starting production work.