AI Evaluator | $30/hr Remote

Crossing Hurdles; United States; Remote; USD 21,000 - 41,000; Full time

Job summary

Crossing Hurdles is seeking a Contractor (Remote) to perform realistic, everyday digital tasks using AI assistant tools under standardized conditions. Compensation is $15-$30 per hour, with a commitment of 10-40 hours per week.

You will give AI clear instructions, verify results for accuracy, apply grading guidelines to evaluate responses, and test scenarios involving email, calendar invites, and multi-person coordination.

Qualifications

• Exceptional attention to detail and accuracy in reviews.
• Proven time management and self-organization for remote work.
• Strong written communication for reporting and updates.
• Experience using AI tools for practical tasks and instruction validation.
• Daily use of Gmail and Google Calendar for personal management tasks.

Responsibilities

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks and verify its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses.
• Test scenarios involving email threads, calendar invites, and multi-person coordination.
• Utilize AI training tools to record findings and submit evaluation data.
• Collaborate with project trainers to resolve ambiguities and refine guidelines.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

Skills

Attention to detail

Time management

Self-organization

Written communication

AI tooling experience

Tools

Gmail

Google Calendar

Job description

Type: Contractor, Remote

Compensation: $15 - $30/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks and verify its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses.
• Test scenarios involving email threads, calendar invites, and multi-person coordination.
• Utilize AI training tools to record findings and submit evaluation data.
• Collaborate with project trainers to resolve ambiguities and refine guidelines.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

Requirements

• Daily, hands-on use of Gmail and Google Calendar for personal management tasks.
• Regular experience coordinating with others over email or text.
• Comfort booking things online independently, such as restaurants or travel.
• Experience using AI tools for practical tasks, with comfort giving instructions and checking work.
• Exceptional attention to detail and accuracy when reviewing AI-generated output.
• Strong written communication skills for clear reporting and updates.
• Demonstrated time management and self-organization for independent, remote project participation.