AI Media Evaluator — Remote, Flexible Hours

Outlier; Las Cruces (NM); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Missions surge pricing

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media and participate in live conversations with AI voice models. You will score exchanges, compare AI-created images and videos against prompts, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your assessments help shape how advanced AI systems reason, learn, and improve. You’ll contribute to a feedback loop that translates frontier research into better real-world AI

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail; ability to replay or zoom in when something seems off.
• Bachelor's degree or above preferred.
• Able to articulate decisions in writing when evaluating outputs.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Conduct live conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to prompts and judge which adheres best to instructions.
• Inspect outputs closely (zooming/replaying) to spot AI artifacts, mismatches, or distortions.
• Provide written explanations citing what was observed and why a particular choice was made.

Skills

Fluent English

Attention to detail

Strong written communication

Clear decision making

Adaptability

Education

Bachelor's degree

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media and participate in live conversations with AI voice models. You will score exchanges, compare AI-created images and videos against prompts, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your assessments help shape how advanced AI systems reason, learn, and improve. You’ll contribute to a feedback loop that translates frontier research into better real-world AI