Remote AI Media Evaluator & Quality Feedback Specialist

Scale AI; Markham; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Weekly payments

Job summary

Outlier, an AI evaluation platform, is hiring English-speaking experts to review AI-generated media. You will roleplay live conversations with an AI voice model, compare AI-generated images and videos, and explain what looked off, remotely on your own schedule.

You will help shape how advanced AI systems reason and learn by providing detailed, evidence-based assessments. This freelance role offers flexible hours and weekly payout.

Qualifications

• Fluent English with strong written communication and ability to explain decisions clearly.
• High attention to detail; patient when replaying and zooming in to check AI outputs.
• Comfortable thinking on your feet and discussing realistic scenarios in conversation.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge alignment with prompts.
• Inspect outputs closely and identify issues like distorted anatomy, flickering, or misaligned audio.
• Write concise English explanations pointing to observed issues and rationale.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based reviews

Decision making

Education

Bachelor’s degree or above

Job description

Outlier, an AI evaluation platform, is hiring English-speaking experts to review AI-generated media. You will roleplay live conversations with an AI voice model, compare AI-generated images and videos, and explain what looked off, remotely on your own schedule.

You will help shape how advanced AI systems reason and learn by providing detailed, evidence-based assessments. This freelance role offers flexible hours and weekly payout.