Remote AI Media Evaluator: Spot Flaws & Score Quality

Outlier; New Westminster; Remote; CAD 23,000 - 35,000; Part time

Benefits offered by this job

Flexible schedule

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare images and videos, and explain what’s off and why, all remotely.

Join Outlier to influence how advanced AI systems reason and improve. You’ll help turn frontier research into practical, real-world performance while earning by the hour with weekly payments and access to top LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor’s degree or above.
• Comfortable thinking on your feet and talking through realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing pairs of AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely (zooming in, replaying) to spot problems like distortions, flickering, or misaligned audio.
• Providing written explanations pointing to what was observed and heard.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Explanations writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare images and videos, and explain what’s off and why, all remotely.

Join Outlier to influence how advanced AI systems reason and improve. You’ll help turn frontier research into practical, real-world performance while earning by the hour with weekly payments and access to top LLMs.