Remote AI Evaluator — English QA Specialist

Outlier; Halifax; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly pay

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely. You will hold live conversations with AI voice models, compare image/video pairs for prompt adherence, and explain in writing what looked off on a flexible schedule.

Pay is up to $15/hour USD with additional incentives. Roles involve evaluating image, video, and audio outputs, rating quality and realism, and providing evidence-based explanations.

Qualifications

• Fluent English and clear written communication are required.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and speaking through realistic scenarios.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated images and videos and judging alignment with prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-video mismatches.
• Rating outputs across dimensions and writing explanations in English for the observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable conversation

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely. You will hold live conversations with AI voice models, compare image/video pairs for prompt adherence, and explain in writing what looked off on a flexible schedule.

Pay is up to $15/hour USD with additional incentives. Roles involve evaluating image, video, and audio outputs, rating quality and realism, and providing evidence-based explanations.