Remote Gmail & Calendar AI Evaluator – Contract

Xperteez Technology Pvt Ltd; United States; Remote; USD 34,000 - 55,000; Part time

Job summary

Xperteez Technology Pvt Ltd seeks a Remote Gmail & Google Calendar AI Assistant Evaluator in the United States. The role focuses on performing realistic digital tasks using AI tools, giving clear instructions, and reviewing results for accuracy, under defined guidelines.

You will grade AI outputs, annotate results, and provide structured feedback to help improve model performance. This is a contract, remote position targeting strict evaluation standards.

Qualifications

• Must be based in the US with an iPhone (iMessage) and have a Facebook or Instagram account.
• Daily, hands-on use of Gmail and Google Calendar to manage personal tasks (emails, invites, scheduling).
• Experience coordinating with others via email/text to set up meetings and manage plans.
• Comfort booking online (restaurants, appointments, travel, deliveries) independently.
• Experience using AI tools for real tasks, with ability to instruct and verify results.
• Excellent attention to detail and accuracy when reviewing AI outputs.
• Strong written communication for clear progress reporting and updates.
• Good time management for independent, remote project participation.

Responsibilities

• Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
• Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
• Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
• Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
• Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.

Skills

Gmail

Google Calendar

AI Usage

Scheduling

Emails

Google Meetings

iPhone with iMessage

Facebook or Instagram account

Job description

Xperteez Technology Pvt Ltd seeks a Remote Gmail & Google Calendar AI Assistant Evaluator in the United States. The role focuses on performing realistic digital tasks using AI tools, giving clear instructions, and reviewing results for accuracy, under defined guidelines.

You will grade AI outputs, annotate results, and provide structured feedback to help improve model performance. This is a contract, remote position targeting strict evaluation standards.