iOS/macOS Evaluator Expert

Mercor is seeking detail-oriented writing experts to contribute to a high-impact AI research project with a leading lab. Freelancers will use their AI input prompts to evaluate advanced language models. This is a short-term, flexible opportunity for professionals with strong academic backgrounds and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

### Job Details:

• Design and Optimize Prompts: Create detailed prompts with multiple constraints and instructions.
• Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations, choosing and explaining model preferences.
• Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

### Minimum Qualifications:

• BS or BA from a reputable institution completed or in progress
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies / general interests.
• Use of macOS and/or iOS on a day-to-day basis.
• US or Canada based.

### Preferred Qualifications:

• Experience in teaching or research.

### Application & Onboarding Process:

• Complete an AI-led interview, this should take around 15 minutes.
• If selected, you will be invited to work on the project.

### More Details About This Role:

• Expect to contribute at least 20 hours per week.
• Expect a commitment starting 2-3 weeks, with strong potential to expand.
• You’ll be working in a structured project environment with clear goals and tools.