AI Output Quality Evaluator — Remote & Flexible Hours

Outlier; Corvallis (OR); Remote; USD 21,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and score each exchange, comparing generated images and videos to the prompts and explaining what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This flexible, fully remote role offers weeks with varying hours and payments, with access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural each sounded.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot problems like distorted motion, text errors, or mismatched audio, and writing explanations.

Skills

Fluent English

Attention to detail

Bachelor's degree or above

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and score each exchange, comparing generated images and videos to the prompts and explaining what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This flexible, fully remote role offers weeks with varying hours and payments, with access to leading LLMs.