← Back to Gigs
Data Annotation
$15 - $30 per hour

Gmail & Google Calendar AI Assistant Evaluator

Apply Now →

SignalGigs may earn a referral fee if you apply through this link.

Description

Role

Test practical digital tasks under standardized, repeatable conditions. Draw on everyday management of email, calendars, bookings, and shared plans to assess whether an AI assistant completes delegated work correctly.

Responsibilities

  • Complete realistic emailing, scheduling, booking, and coordination tasks with AI-assistant tools.
  • Give clear task instructions, then verify the assistant’s work for accuracy and completeness.
  • Grade, rank, and annotate responses using detailed guidelines, with structured feedback on model performance.
  • Test email threads, calendar invitations, online bookings, and multi-person coordination across varied situations and edge cases.
  • Record findings and submit evaluation data through the supplied training tools, meeting project standards and milestones.
  • Resolve ambiguities with trainers and contributors, refining guidance and maintaining consistency.
  • Participate in continuing quality reviews and incorporate feedback into later evaluations.

Qualifications

  • Based in the United States, with an iPhone that supports iMessage and a Facebook or Instagram account.
  • Daily hands-on Gmail and Google Calendar use for sending messages, accepting invitations, scheduling, and rearranging plans.
  • Regular email or text coordination with other people, including meetups, thread follow-ups, shared plans, and payments.
  • Independent experience booking restaurants, appointments, travel, deliveries, or similar services online.
  • Practical AI-tool experience, including giving instructions and checking the resulting work.
  • Exceptional attention to detail when reviewing AI output.
  • Strong writing for clear reporting and timely progress or issue updates.
  • Good time management and independent organization in remote projects.

Preferred experience

AI evaluation, data labeling, user testing, or similar feedback-driven projects are helpful. Prompt-writing experience, understanding assistant limitations, and grading outputs for accuracy, helpfulness, and safety are also valuable.

Engagement terms

Remote contractor engagement restricted to the United States.

Details

Hiring company

Micro1

Category

Data Annotation

Location

Remote — United States

Posted

Interested? You'll apply on the hiring company's own site.

Apply Now →

SignalGigs may earn a referral fee if you apply through this link.

Join the job-alert list

Alerts are not being sent yet.

Pay Data

How Much Do AI Jobs Pay?

→
Guide

How to Get Started

→
Gmail & Google Calendar AI Assistant Evaluator
$15 - $30 per hour
Apply Now →