Remote AI Evaluator & QA Specialist (Contractor)

Crossing Hurdles; United States; Remote; USD 21,000 - 41,000; Full time

Job summary

Crossing Hurdles is seeking a Contractor (Remote) to perform realistic, everyday digital tasks using AI assistant tools under standardized conditions. Compensation is $15-$30 per hour, with a commitment of 10-40 hours per week.

You will give AI clear instructions, verify results for accuracy, apply grading guidelines to evaluate responses, and test scenarios involving email, calendar invites, and multi-person coordination.

Qualifications

• Exceptional attention to detail and accuracy in reviews.
• Proven time management and self-organization for remote work.
• Strong written communication for reporting and updates.
• Experience using AI tools for practical tasks and instruction validation.
• Daily use of Gmail and Google Calendar for personal management tasks.

Responsibilities

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks and verify its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses.
• Test scenarios involving email threads, calendar invites, and multi-person coordination.
• Utilize AI training tools to record findings and submit evaluation data.
• Collaborate with project trainers to resolve ambiguities and refine guidelines.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

Skills

Attention to detail

Time management

Self-organization

Written communication

AI tooling experience

Tools

Gmail

Google Calendar

Job description

Crossing Hurdles is seeking a Contractor (Remote) to perform realistic, everyday digital tasks using AI assistant tools under standardized conditions. Compensation is $15-$30 per hour, with a commitment of 10-40 hours per week.

You will give AI clear instructions, verify results for accuracy, apply grading guidelines to evaluate responses, and test scenarios involving email, calendar invites, and multi-person coordination.