Remote AI Evaluator: Live Dialogs & Image/Video Judging

Scale AI; Ottawa; Hybrid; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Free access to leading LLMs

Job summary

Outlier, an AI training platform operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank naturalness, compare images/videos, and explain findings in writing, all remotely and on your own schedule.

Responsibilities include evaluating image and video prompts, reporting issues such as distorted motion or misalignment, and providing clear, concise explanations in English.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience for replaying or zooming in.
• Ability to think on your feet and describe realistic scenarios.
• Experience writing concise, evidence-based explanations.
• Capable of decisive choices when both options have flaws.

Responsibilities

• Hold live English conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and judge alignment with prompts.
• Inspect outputs for distortions, artifacts, or misalignment and document issues.
• Write English explanations detailing what you observed or heard.

Skills

Fluent English

Attention to detail

Clear thinking on your feet

Experience writing evidence-based exps

Decision making under ambiguity

Education

Bachelor’s degree or higher

Job description

Outlier, an AI training platform operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank naturalness, compare images/videos, and explain findings in writing, all remotely and on your own schedule.

Responsibilities include evaluating image and video prompts, reporting issues such as distorted motion or misalignment, and providing clear, concise explanations in English.