Remote AI Evaluation & Training Specialist

Scale AI; Eastern Ontario; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global expert community

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare images and videos for prompt adherence, and explain what looked or sounded wrong, remotely and on your own schedule.

Responsibilities include inspecting outputs for distortions, misalignment, and artifacts, rating across dimensions, and writing concise explanations in English. This is a telework, contract-style opportunity.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and the patience to replay or zoom in.
• Able to think on your feet and describe reasoning clearly.
• Experience writing short, evidence-based explanations.
• Able to make a clear decision when options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like artifacts, distortions, or misalignment.
• Provide written explanations detailing what was observed and why a choice was made.

Skills

Fluent English

Attention to detail

Conversational thinking

Written explanations

Clear decision making

Education

Bachelor’s degree preferred

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare images and videos for prompt adherence, and explain what looked or sounded wrong, remotely and on your own schedule.

Responsibilities include inspecting outputs for distortions, misalignment, and artifacts, rating across dimensions, and writing concise explanations in English. This is a telework, contract-style opportunity.