AI Media Quality Evaluator — Remote & Flexible Hours

Outlier; Salem (OR); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Remote work

Free LLM access

Surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images and videos to judge prompt adherence, and explain issues in writing from home on your own schedule.

As part of Outlier’s evaluation loop, your work helps shape how advanced AI systems reason and perform in real-world tasks. This paid remote opportunity offers flexibility and potential incentives.

Qualifications

• Fluent English and strong written communication are required.
• Excellent attention to detail and ability to write concise explanations.
• Bachelor's degree or higher preferred.
• Ability to think quickly and discuss realistic scenarios clearly.
• Experience writing evidence-based reviews is a plus.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos to assess adherence to prompts.
• Inspect outputs closely to spot issues like distortions or misalignment.
• Write English explanations pointing to observed issues and improvements.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images and videos to judge prompt adherence, and explain issues in writing from home on your own schedule.

As part of Outlier’s evaluation loop, your work helps shape how advanced AI systems reason and perform in real-world tasks. This paid remote opportunity offers flexibility and potential incentives.