LLM S2 Annotator (CUA Trajectory Specialist)

LLM S2 Annotator (CUA Trajectory Specialist)

skilled professionals to contribute as S2 Annotators, responsible for producing and validating high-quality Computer-Use Agent (CUA) trajectories for developer-adjacent workflows.

Day-to-day

• Create detailed, step-by-step positive CUA trajectories for technical tasks (e.g., file manipulation, scripting, API calls, browser-based workflows)
• Break down natural language instructions into clear, verifiable actions
• Validate and review trajectories for correctness, completeness, and reproducibility
• Work within Linux desktop environments to execute and document workflows
• Use scripting (Python/Bash) to simulate or validate task execution where required
• Interact with tools and environments involving APIs, terminals, and browser automation
• Collabo

You bring

• 2–5 years of experience in software development, technical support, or similar technical roles
• Strong familiarity with Linux environments and command-line operations
• Proficiency in at least one scripting language: Python or Bash
• Ability to decompose complex instructions into structured, step-by-step workflows
• Strong attention to detail in documenting technical processes
• Exposure to LLM-based tools, AI systems, or agentic workflows
• Basic understanding of APIs, file systems, and developer tooling

Bonus

• Prior experience in data annotation, RLHF, or SFT labeling workflows
• Exposure to CI/CD pipelines, REST APIs, or terminal-based automation
• Experience working with browser automation tools or developer productivity tools
• Background in evaluating or improving AI-generated outputs

Pay

• Start: is next week].
• Commitments Required: At least 4 hours per day and a minimum of 20 hours per week, with a 4-hour overlap with PST.
• Contractor position (Note: this role does not include medical/paid leave).