AI Evaluation Specialist - Remote, Flexible Hours

Scale AI; Alaska; Remote; USD 25,000 - 39,000; Full time

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay conversations with an AI voice model, rank outputs, and explain what looked or sounded off, remotely and on your own schedule.

Ideal candidates have fluent English, sharp attention to detail, and experience writing concise, evidence-based explanations. Remote work with flexible hours is available.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to notice nuances.
• Think on your feet and explain decisions clearly.
• Experience writing concise, evidence-based reviews.
• Ability to decide when both options have flaws.
• Nice to have: Bachelor's degree or above.

Responsibilities

• Review AI-generated media and provide written explanations.
• Rank outputs for naturalness, usefulness, and clarity.
• Compare AI-generated images/videos to assess prompt adherence.
• Detail issues with outputs, including visual/audio mismatches.

Skills

Attention to detail

Strong written communication

English fluency

Decision making under ambiguity

Clear explanations

Education

Bachelor's degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay conversations with an AI voice model, rank outputs, and explain what looked or sounded off, remotely and on your own schedule.

Ideal candidates have fluent English, sharp attention to detail, and experience writing concise, evidence-based explanations. Remote work with flexible hours is available.