Remote AI Evaluation Specialist (Text/Image/Video)

Outlier (by Scale AI); United States; Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Job summary

Outlier, an AI training platform by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, explaining in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, rating adherence and realism, and writing concise explanations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs to spot issues like distorted motion, text errors, or audio-video mismatches.
• Write explanations in English pointing to observed issues.

Skills

Fluent English

Attention to detail

Evidence-based writing

Education

Bachelor's degree or above

Job description

Outlier, an AI training platform by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, explaining in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, rating adherence and realism, and writing concise explanations.