Remote AI Evaluation Specialist - Flexible Hours

Scale AI; North Bay; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Job summary

Outlier, a platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and justify your judgments with precise explanations.

Tasks include comparing AI-generated images and videos, labeling captions, and assessing audio-visual alignment, all on a flexible freelance schedule. You’ll work remotely from anywhere, with weekly payments and incentives tied to project performance,

Qualifications

• Fluent English and strong written communication are required.
• Excellent attention to detail and ability to replay or zoom in to verify outputs.
• Comfortable making clear decisions when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge adherence to the prompt.
• Inspect outputs closely and explain in writing what looked or sounded off, with concrete examples.

Skills

Fluent English

Strong writing

Attention to detail

Timely decision making

Education

Bachelor’s degree preferred

Job description

Outlier, a platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and justify your judgments with precise explanations.

Tasks include comparing AI-generated images and videos, labeling captions, and assessing audio-visual alignment, all on a flexible freelance schedule. You’ll work remotely from anywhere, with weekly payments and incentives tied to project performance,