← Back to Gigs
Data Annotation
$15 - $30 per hour
Gmail & Google Calendar AI Assistant Evaluator
Apply Now →SignalGigs may earn a referral fee if you apply through this link.
Description
Role
Test practical digital tasks under standardized, repeatable conditions. Draw on everyday management of email, calendars, bookings, and shared plans to assess whether an AI assistant completes delegated work correctly.
Responsibilities
- Complete realistic emailing, scheduling, booking, and coordination tasks with AI-assistant tools.
- Give clear task instructions, then verify the assistant’s work for accuracy and completeness.
- Grade, rank, and annotate responses using detailed guidelines, with structured feedback on model performance.
- Test email threads, calendar invitations, online bookings, and multi-person coordination across varied situations and edge cases.
- Record findings and submit evaluation data through the supplied training tools, meeting project standards and milestones.
- Resolve ambiguities with trainers and contributors, refining guidance and maintaining consistency.
- Participate in continuing quality reviews and incorporate feedback into later evaluations.
Qualifications
- Based in the United States, with an iPhone that supports iMessage and a Facebook or Instagram account.
- Daily hands-on Gmail and Google Calendar use for sending messages, accepting invitations, scheduling, and rearranging plans.
- Regular email or text coordination with other people, including meetups, thread follow-ups, shared plans, and payments.
- Independent experience booking restaurants, appointments, travel, deliveries, or similar services online.
- Practical AI-tool experience, including giving instructions and checking the resulting work.
- Exceptional attention to detail when reviewing AI output.
- Strong writing for clear reporting and timely progress or issue updates.
- Good time management and independent organization in remote projects.
Preferred experience
AI evaluation, data labeling, user testing, or similar feedback-driven projects are helpful. Prompt-writing experience, understanding assistant limitations, and grading outputs for accuracy, helpfulness, and safety are also valuable.
Engagement terms
Remote contractor engagement restricted to the United States.
Details
Interested? You'll apply on the hiring company's own site.
Apply Now →SignalGigs may earn a referral fee if you apply through this link.
Related Opportunities
Pay Data
→How Much Do AI Jobs Pay?
Guide
→How to Get Started
Gmail & Google Calendar AI Assistant Evaluator
$15 - $30 per hour