AI Assistant Evaluator: Email, Scheduling & AI Training

Codefeast; United States; On-site; USD 50,000 - 85,000; Full time

Job summary

Codefeast is seeking a detail-oriented AI trainer evaluator to perform email, scheduling, booking, and coordination tasks using AI assistants. You will verify outputs and provide actionable feedback to improve training data.

You will test scenarios across email threads, calendars, and multi-person coordination, record findings, and collaborate with trainers to ensure consistency and high-quality results in daily workflow tasks.

Qualifications

• Based in the US; possesses an iPhone (iMessage) and a Facebook or Instagram account.
• Daily use of Gmail and Google Calendar.
• Experience coordinating via email/text and booking online.
• Comfortable using AI tools and reviewing AI-generated output.
• Strong written communication and attention to detail.
• Preferred: AI evaluation, data labeling, or prompt-writing experience.

Responsibilities

• Complete everyday digital tasks (email, scheduling, booking, coordination) using AI assistant tools.
• Review and verify AI assistant work for accuracy and completeness.
• Apply grading guidelines to evaluate and annotate responses.
• Test diverse scenarios: email threads, calendar invites, bookings, multi-person coordination.
• Record findings and submit evaluation data via AI training platforms.
• Collaborate with trainers to resolve ambiguities and maintain consistency.

Skills

Attention to detail

Written communication

Email scheduling coordination

AI evaluation / data labeling

Tools

Gmail

Google Calendar

AI training platforms

Job description

Codefeast is seeking a detail-oriented AI trainer evaluator to perform email, scheduling, booking, and coordination tasks using AI assistants. You will verify outputs and provide actionable feedback to improve training data.

You will test scenarios across email threads, calendars, and multi-person coordination, record findings, and collaborate with trainers to ensure consistency and high-quality results in daily workflow tasks.