AI Content & Relevance Evaluator (Remote)

Scale AI; Lethbridge; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible freelance schedule

Weekly payments

Free access to leading AI tools

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Evaluate images, videos, and audio across prompts for adherence, quality, and realism, providing written explanations. This is a freelance, 1099 role with flexible hours and weekly payments.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and the ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and describing realistic scenarios clearly.
• Experience writing brief, evidence-based explanations or reviews.
• Able to decide clearly when options have flaws, even if both are imperfect.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge which better follows prompts.
• Inspect outputs closely to spot issues like anatomy distortion, flicker, or misaligned audio.
• Write concise explanations in English detailing what you observed for each task.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Evaluate images, videos, and audio across prompts for adherence, quality, and realism, providing written explanations. This is a freelance, 1099 role with flexible hours and weekly payments.