AI Evaluation Specialist

Scale AI

Richmond

Hybrid

CAD 24,000 - 34,000

Full time

6 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule

Free LLM access

Global community of experts

Weekly payments

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score naturalness and usefulness, and explain in writing what looked or sounded off.

You will compare AI-generated images and videos to prompts, rating adherence and quality, and provide concise, evidence-based explanations. This freelance/1099 contract offers flexible hours and weekly payments.

Qualifications

Fluent English with strong written communication.
Excellent attention to detail and patience to replay or zoom in when something seems off.
Comfortable thinking on your feet and explaining realistic scenarios clearly.
Experience writing short, evidence-based explanations or reviews.
Able to make clear decisions when both options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
Comparing AI-generated images and videos and judging adherence to prompts.
Inspecting outputs closely to spot problems like distortion, flickering, or misaligned audio/video.
Rating outputs on dimensions like adherence, quality, and realism and providing concise explanations in English.