Remote AI Evaluation Specialist (Text/Image/Video)

Scale AI; Steinbach; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Weekly payouts

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI‑generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

Ideal candidates will evaluate images, videos, captions, and audio, writing concise, evidence‑based explanations in English. This freelance role offers flexible hours, weekly payouts, and competitive per‑hour rates.

Qualifications

• Fluent English with strong written communication.
• High attention to detail and patience to replay or zoom in.
• Comfortable thinking on your feet and talking through scenarios.
• Experience writing concise, evidence-based reviews.
• Bachelor’s degree or above preferred.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models, then rank naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge which follows the prompt better.
• Inspect outputs closely for artifacts, distortions, or misalignments and explain findings in writing.
• Provide written explanations in English that point to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Live conversation ability

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI‑generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

Ideal candidates will evaluate images, videos, captions, and audio, writing concise, evidence‑based explanations in English. This freelance role offers flexible hours, weekly payouts, and competitive per‑hour rates.