Remote AI Evaluator for Gmail & Calendar Assistants

Executive Staff Recruiters / ESR Healthcare; United States; Remote; USD 34,000 - 62,000; Part time

Job summary

Executive Staff Recruiters / ESR Healthcare is seeking a meticulous Gmail & Google Calendar AI Assistant Evaluator for a remote contract role based in the United States. You will perform real-world digital tasks, give AI clear instructions, and review results to ensure accuracy under established guidelines.

Ideal candidates demonstrate strong written communication, time management, and exceptional attention to detail while collaborating with project trainers to maintain high-quality evaluation

Qualifications

• US-based resident required.
• Own iPhone with iMessage.
• Social media accounts (Facebook/Instagram) preferred but not required.
• Daily use of Gmail and Google Calendar for personal scheduling.
• Strong attention to detail and accuracy in reviewing AI output.

Responsibilities

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Provide clear instructions to AI assistant and verify its work for accuracy and completeness.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses with structured feedback.
• Test scenarios involving emails, calendar invites, bookings, and multi-person coordination.
• Record findings and submit evaluation data using AI training platforms per project milestones.
• Collaborate with trainers to resolve ambiguities and ensure evaluation consistency.
• Participate in ongoing quality reviews and implement feedback to raise standards.

Skills

Gmail

Google Calendar

Email coordination

Attention to detail

Written communication

Remote work

Tools

AI evaluation platforms

Data labeling tools

Job description

Executive Staff Recruiters / ESR Healthcare is seeking a meticulous Gmail & Google Calendar AI Assistant Evaluator for a remote contract role based in the United States. You will perform real-world digital tasks, give AI clear instructions, and review results to ensure accuracy under established guidelines.

Ideal candidates demonstrate strong written communication, time management, and exceptional attention to detail while collaborating with project trainers to maintain high-quality evaluation