Lead Generative AI Analyst

Generative AI data leadership

Coordinate customers, data operations, product staff, and research teams while guiding labeling initiatives. Track annotator performance, develop clear instructions, and help teams create reliable language model datasets.

Responsibilities

• Write creative prompts and responses across varied subjects.
• Manage labeling work with external partners and internal customers.
• Develop and maintain detailed guidelines and specifications.
• Train teams in practices for building language models and datasets.
• Monitor quality metrics and deliverables.

Qualifications

Native English and excellent written and spoken communication are required, along with a record of delivering quality work on time. Applicants need a four year degree or equivalent experience and specialist knowledge in areas such as law, gardening, biology, U.S. history, or engineering.

More than 1 year delivering LLM products, relevant subject studies, understanding of RLHF, annotation for neural network preparation, and QA experience help distinguish candidates. Python scripting is an advantage.

The role may involve sexually explicit, graphic, disturbing, or otherwise offensive content.