Remote Gmail & Calendar AI Evaluator (Contractor)

Remotebridge; Northern (KY); Remote; USD 60,000 - 90,000; Part time

Job summary

Frontier AI Lab is seeking a Gmail & Google Calendar AI Assistant Evaluator to work remotely as a contractor in the United States. You will perform everyday digital tasks, give clear AI instructions, and review results for accuracy. The role focuses on evaluating AI assistants with structured feedback and detailed grading guidelines.

You will handle emails, invites, scheduling, and coordination scenarios, and contribute to project milestones with precise data submissions and quality reviews.

Qualifications

• Based in the US and able to work remotely on a contract basis.
• Daily use of Gmail and Google Calendar to manage personal tasks.
• Experience coordinating with others via email or text for meetups or plans.
• Comfort booking online (restaurants, travel, appointments, deliveries).
• Experience using AI tools for real-world tasks and validating outputs.
• Strong attention to detail and clear written reporting.

Responsibilities

• Complete realistic digital tasks (emailing, scheduling, booking, coordinating) using AI tools under standardized conditions.
• Provide clear instructions to AI assistants and review results for accuracy and completeness.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses with feedback.
• Test scenarios involving emails, calendar invites, bookings, and multi-person coordination.
• Record findings and submit evaluation data per project milestones.
• Collaborate with trainers to resolve ambiguities, refine guidelines, and ensure consistency.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

Skills

US-based

Gmail proficiency

Google Calendar

Attention to detail

Written communication

Time management

AI tools experience

iPhone/iMessage

Social accounts (Facebook/Instagram)

Remote/independent work

Tools

AI evaluation tools

Data labeling platforms

Job description

Frontier AI Lab is seeking a Gmail & Google Calendar AI Assistant Evaluator to work remotely as a contractor in the United States. You will perform everyday digital tasks, give clear AI instructions, and review results for accuracy. The role focuses on evaluating AI assistants with structured feedback and detailed grading guidelines.

You will handle emails, invites, scheduling, and coordination scenarios, and contribute to project milestones with precise data submissions and quality reviews.