Gmail & Google Calendar AI Assistant Evaluator

HumanitApp

United States

Remote

USD 21,000 - 41,000

Full time

8 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

HumanitApp seeks a contractor to remotely evaluate Gmail and Google Calendar AI assistants for a US-based program. You will perform real-world digital tasks and manage your own life while guiding AI through tasks and collecting quality feedback.

Responsibilities include issuing clear task instructions, reviewing AI outputs for accuracy, and applying structured grading guidelines to improve model performance. Strong communication and self-management are essential.

Qualifications

  • Strong attention to detail and accuracy when reviewing AI outputs.
  • Excellent written communication for timely progress updates.
  • Ability to work independently and manage your own schedule remotely.

Responsibilities

  • Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized conditions.
  • Give AI assistant clear instructions for real-world tasks and verify its work for accuracy and completeness.
  • Apply grading guidelines to evaluate, rank, and annotate assistant responses with structured feedback.

Skills

Attention to detail
Clear written communication
Independent work
Time management
Task prioritization

Tools

Gmail
Google Calendar

Job description

Role Type: Contractor, Remote

Location: United States only

micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life

email, calendars, bookings, and coordination

to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.

Key Responsibilities:

Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.

Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.

Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.

Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.

Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.

Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.

Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.

Required Skills and Qualifications:

Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.

Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.

Regular experience coordinating with others over email or text

setting up meetups, following up on threads, or confirming shared plans and payments.

Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.

Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.

Exceptional attention to detail and accuracy when reviewing AI-generated output.

Strong written communication skills for clear reporting and timely updates on progress and challenges.

Demonstrated time management and self-organization for independent, remote project participation.

Preferred Qualifications:

Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.

Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limits.

Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.

Source: micro1 official job description, checked 2026-11-12. Confirm current availability, country eligibility and final terms on the official listing. Certification does not guarantee paid work.

The listing states $15 - $30/hour. Confirm the final rate, workload, and payment terms during the official application process.

  • Review the official description below for experience and equipment requirements.
  • Confirm location eligibility, language requirements and weekly availability with the partner.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Gmail & Google Calendar AI Assistant Evaluator
Gmail & Google Calendar AI Assistant Evaluator

micro1 Inc. • United States

Remote
USD 34,000 - 55,000
Gmail & Google Calendar AI Assistant Evaluator
Gmail & Google Calendar AI Assistant Evaluator

Confidential • United States

Remote
USD 34,000 - 83,000
Gmail & Calendar AI Evaluator - Remote, Part-Time
Gmail & Calendar AI Evaluator - Remote, Part-Time

OpenTrain AI, Inc. • United States

Hybrid
USD 21,000 - 41,000
Gmail and Google Calendar AI Assistant Evaluator
Gmail and Google Calendar AI Assistant Evaluator

OpenTrain AI, Inc. • United States

Hybrid
USD 21,000 - 41,000
Gmail & Google Calendar AI Assistant Evaluator
Gmail & Google Calendar AI Assistant Evaluator

Remotebridge • United States

Remote
USD 60,000 - 90,000
Gmail & Calendar AI Evaluator - Remote Contractor
Gmail & Calendar AI Evaluator - Remote Contractor

micro1 Inc. • United States

Remote
USD 34,000 - 55,000
AI Evaluator | $30/hr Remote
AI Evaluator | $30/hr Remote

Crossing Hurdles • United States

Remote
USD 21,000 - 41,000
Remote Gmail & Calendar AI Evaluator
Remote Gmail & Calendar AI Evaluator

HumanitApp • United States

Remote
USD 21,000 - 41,000
Remote Gmail & Calendar AI Evaluator (Contractor)
Remote Gmail & Calendar AI Evaluator (Contractor)

Remotebridge • United States

Remote
USD 60,000 - 90,000
Gmail & Google Calendar AI Assistant Evaluator
Gmail & Google Calendar AI Assistant Evaluator

Auraone • United States

Remote
USD 34,000 - 62,000