Remote AI Evaluation Specialist (English)

Outlier; Santa Cruz (CA); Remote; USD 12,000 - 21,000; Part time

Benefits offered by this job

Free LLM access

Weekly payments

Remote work

Flexible hours

Job summary

Outlier is offering a fully remote, flexible-hours contract where you will review AI-generated media by holding live conversations with AI voice models and scoring each exchange. You will compare pairs of generated images and videos to judge which follows the prompt more accurately, then explain what looked or sounded wrong in written form.

The role shapes how advanced AI systems reason and improve. The position emphasizes attention to detail, clear English communication, and the ability to

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and careful listening.
• Ability to explain observations clearly in writing.
• Willingness to think on your feet and assess realistic scenarios.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank how natural and useful each interaction sounded.
• Compare AI-generated images and videos for adherence to prompts.
• Inspect outputs closely to spot errors in anatomy, motion, text, or audio.
• Write a concise explanation in English detailing observed issues and rationale.

Skills

Fluent English

Attention to detail

Clear written communication

Problem solving

Education

Bachelor's degree or above

Job description

Outlier is offering a fully remote, flexible-hours contract where you will review AI-generated media by holding live conversations with AI voice models and scoring each exchange. You will compare pairs of generated images and videos to judge which follows the prompt more accurately, then explain what looked or sounded wrong in written form.

The role shapes how advanced AI systems reason and improve. The position emphasizes attention to detail, clear English communication, and the ability to