Gmail & Google Calendar AI Assistant Evaluator | $15–30/hr

Codefeast; United States; On-site; USD 50,000 - 85,000; Full time

Job summary

Codefeast is seeking a detail-oriented AI trainer evaluator to perform email, scheduling, booking, and coordination tasks using AI assistants. You will verify outputs and provide actionable feedback to improve training data.

You will test scenarios across email threads, calendars, and multi-person coordination, record findings, and collaborate with trainers to ensure consistency and high-quality results in daily workflow tasks.

Qualifications

• Based in the US; possesses an iPhone (iMessage) and a Facebook or Instagram account.
• Daily use of Gmail and Google Calendar.
• Experience coordinating via email/text and booking online.
• Comfortable using AI tools and reviewing AI-generated output.
• Strong written communication and attention to detail.
• Preferred: AI evaluation, data labeling, or prompt-writing experience.

Responsibilities

• Complete everyday digital tasks (email, scheduling, booking, coordination) using AI assistant tools.
• Review and verify AI assistant work for accuracy and completeness.
• Apply grading guidelines to evaluate and annotate responses.
• Test diverse scenarios: email threads, calendar invites, bookings, multi-person coordination.
• Record findings and submit evaluation data via AI training platforms.
• Collaborate with trainers to resolve ambiguities and maintain consistency.

Skills

Attention to detail

Written communication

Email scheduling coordination

AI evaluation / data labeling

Tools

Gmail

Google Calendar

AI training platforms

Job description

Role Overview

Use AI assistants for realistic email, scheduling, booking, and coordination tasks. Check task completion, grade responses against instructions, and provide clear feedback to help train next-generation AI assistants.

Key Responsibilities

• Complete everyday digital tasks (email, scheduling, booking, coordination) using AI assistant tools.
• Review and verify AI assistant work for accuracy and completeness.
• Apply grading guidelines to evaluate and annotate responses.
• Test diverse scenarios: email threads, calendar invites, bookings, multi-person coordination.
• Record findings and submit evaluation data via AI training platforms.
• Collaborate with trainers to resolve ambiguities and maintain consistency.

Key Requirements

• Based in the US, with an iPhone (iMessage) and a Facebook or Instagram account.
• Daily use of Gmail and Google Calendar.
• Experience coordinating via email/text and booking things online.
• Comfortable using AI tools and reviewing AI-generated output.
• Strong attention to detail and written communication skills.
• Preferred: AI evaluation, data labeling, or prompt-writing experience.