Remote AI Media Quality Evaluator | Flexible Hours

Outlier; Billings (MT); Remote; USD 20,000 - 29,000; Part time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is recruiting detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare images and videos, and explain in writing what looked off, all remotely and on your own schedule.

At Outlier, your evaluations help shape how AI systems reason and improve. This role supports frontier research and contributes to better AI in real-world use cases, with paid weekly on a flexible, remote basis.

Qualifications

• Fluent English with strong written communication skills.
• Excellent attention to detail and careful listening.
• Experience writing short, evidence-based explanations or reviews.
• Ability to explain decisions clearly when both options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge prompt adherence.
• Inspect outputs closely (zooming, replaying) to spot problems such as distortion, flicker, or misalignment of audio/video.
• Provide written explanations in English describing what was seen or heard and why.

Skills

Fluent English

Attention to detail

Clear written communication

Explain reviews clearly

Decisive under ambiguity

Education

Bachelor's degree or higher (nice to have)

Job description

Outlier is recruiting detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare images and videos, and explain in writing what looked off, all remotely and on your own schedule.

At Outlier, your evaluations help shape how AI systems reason and improve. This role supports frontier research and contributes to better AI in real-world use cases, with paid weekly on a flexible, remote basis.