Remote AI Evaluation Specialist — Live Prompts & Media Review

Scale AI; Prince George; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Job summary

Outlier, an AI training platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare AI-generated images and videos to prompts, and write concise explanations of issues observed, all remotely on your own schedule.

Responsibilities include rating outputs on adherence, quality, and realism, and writing evidence-based explanations in English.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay or zoom in to verify facts.
• Able to think on your feet and describe reasoning clearly.
• Experience writing concise, evidence-based reviews or explanations.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos against prompts and judge adherence to instructions.
• Inspect outputs closely to identify artifacts or inconsistencies; explain findings in writing in English.

Skills

Fluent English

Attention to detail

Conversational reasoning

Evidence-based writing

Decision making under ambiguity

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare AI-generated images and videos to prompts, and write concise explanations of issues observed, all remotely on your own schedule.

Responsibilities include rating outputs on adherence, quality, and realism, and writing evidence-based explanations in English.