Gmail & Google Calendar AI Assistant Evaluator at micro1

AI Trainer Jobs; Northern (KY); Hybrid; USD 21,000 - 41,000; Part time

Job summary

micro1 is seeking Gmail & Google Calendar AI Assistant Evaluators to collaborate on a client-driven project that enhances AI assistant quality through real-world task evaluation.

You will apply everyday email/calendar management skills, provide clear task instructions to an AI, review outputs for accuracy, and submit structured feedback that helps training models improve.

This is a remote contractor role in the United States with flexible scheduling.

Qualifications

• Based in the US with an iPhone and iMessage, and a Facebook or Instagram account.
• Daily use of Gmail and Google Calendar to manage your life (emailing, scheduling, invites).
• Experience coordinating with others via email or text for scheduling and planning.
• Comfort booking things online (restaurants, appointments, travel) and using AI tools.
• Attention to detail and accuracy when reviewing AI-generated output.
• Strong written communication for clear reporting and updates on progress.

Responsibilities

• Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks, then review its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses with feedback.

Skills

Gmail

Google Calendar

AI usage

Scheduling

Emails

Google Meetings

iPhone with iMessage

Facebook/Instagram account

Job description

Gmail & Google Calendar AI Assistant Evaluator
$15 - $30/hour
pay
Required Skills
Gmail
Google Calendar
AI Usage
Scheduling
Emails
Google Meetings
About micro1
micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems learn, reason, and perform.

Our platform identifies and vets top talent through an AI recruiter, enabling high-quality expert contributions at scale. We aim to enable 1 billion people to do meaningful work by applying their expertise to AI. As our global expert network grows, micro1 is building the human intelligence layer for frontier AI.

Role Title: Gmail & Google Calendar AI Assistant Evaluator

Role Type: Contractor, Remote

Location: United States only

micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life - email, calendars, bookings, and coordination - to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.

Key Responsibilities:

• Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
• Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
• Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
• Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
• Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.

Required Skills and Qualifications:

• Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.
• Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.
• Regular experience coordinating with others over email or text - setting up meetups, following up on threads, or confirming shared plans and payments.
• Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.
• Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.
• Exceptional attention to detail and accuracy when reviewing AI-generated output.
• Strong written communication skills for clear reporting and timely updates on progress and challenges.
• Demonstrated time management and self-organization for independent, remote project participation.

Preferred Qualifications:

• Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
• Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.
• Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.