Remote AI Evaluation Specialist

Scale AI; Timmins; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global expert network

Job summary

Scale AI’s Outlier program seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and explain discrepancies.

You’ll compare AI-generated images and videos to prompts and articulate what looked wrong, remotely and on your own schedule. Ideal candidates are fluent in English with strong written communication, keen attention to detail, and experience delivering concise, evidence-based reviews.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and ability to describe observations precisely.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when options have flaws.

Responsibilities

• Hold live conversations in English with AI voice models and rate naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge prompt adherence.
• Inspect outputs closely, spotting distortions, artifacts, or misalignments.
• Provide written explanations detailing what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Education

Bachelor’s degree or above

Job description

Scale AI’s Outlier program seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and explain discrepancies.

You’ll compare AI-generated images and videos to prompts and articulate what looked wrong, remotely and on your own schedule. Ideal candidates are fluent in English with strong written communication, keen attention to detail, and experience delivering concise, evidence-based reviews.