Remote AI Media Evaluator: Images & Video

Scale AI; Kelowna; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Join 900K+ Outlier Experts across 52+%

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated content against prompts and explain what looked or sounded wrong, all on your own schedule.

Responsibilities include identifying issues in images, videos, and audio, rating adherence and realism, and writing concise explanations in English.

Qualifications

• Fluent English with strong writing and comprehension skills.
• Excellent attention to detail and ability to replay or zoom in to identify issues.
• Ability to think on your feet and explain decisions clearly in English.
• Experience writing concise, evidence-based reviews or explanations.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judging adherence to prompts.
• Inspect outputs closely (zoom/replay) to spot problems like distortions, glitches, or text/audio misalignments.
• Provide written explanations pointing to observed issues and decisions.

Skills

Fluent English

Attention to detail

Clear reasoning

Evidence-based writing

Decision making

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated content against prompts and explain what looked or sounded wrong, all on your own schedule.

Responsibilities include identifying issues in images, videos, and audio, rating adherence and realism, and writing concise explanations in English.