AI Specialist | Remote

Crossing Hurdles; United States; Remote; USD 36,000 - 47,000; Part time

Job summary

Crossing Hurdles is seeking an AI Evaluator to assess a shopping assistant. This hourly contract role is remote, offering $30 per hour for evaluating AI interactions and improving response quality.

In this role you will review real user traces, identify failures and unhelpful recommendations, and help create rubrics and verifiers for consistent evaluation. Strong analytical skills and familiarity with e-commerce experiences are valued to drive accurate assessments.

Qualifications

• Experience in data evaluation, QA, or AI training.
• Strong analytical skills and ability to spot subtle errors in text.
• Familiarity with e-commerce search and digital shopping experiences.

Responsibilities

• Review real user interaction traces with an AI shopping assistant.
• Identify logical failures, inaccuracies, and unhelpful product recommendations.
• Create structured rubrics and verifiers to judge response quality.

Skills

Data evaluation

Quality assurance

AI training

Analytical skills

E-commerce familiarity

Job description

Position: AI Evaluator : Assessing a Shopping Assistant

Type: Hourly Contract

Compensation: $30/hr

Location: Remote

Role Responsibilities

• Review real user interaction traces with an AI shopping assistant
• Identify logical failures, inaccuracies, and unhelpful product recommendations
• Create structured rubrics and verifiers to judge response quality

Requirements

• Experience in data evaluation, quality assurance, or AI training
• Strong analytical skills and an ability to spot subtle errors in text
• Familiarity with e-commerce search and digital shopping experiences
• Prompt engineering, complex data annotation, or software testing experience is welcome