AI Media Evaluator — Remote, Flexible Hours + Free LLM Access

Outlier; Madison (WI); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Incentives and surge pricing bonuses

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will conduct live conversations with AI voice models, compare image and video outputs, and explain in writing what looked off or misaligned with prompts.

Responsibilities include rating outputs across adherence, quality, and realism, then providing concise explanations. This role shapes how frontier AI systems reason and improve in practice.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful review skills.
• Ability to explain what is off in writing clearly.
• Comfortable thinking on your feet and discussing scenarios.
• Experience writing concise evidence-based explanations.
• Decision-making when two options have flaws.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to judge prompt adherence.
• Inspecting outputs closely to spot distortions, flicker, or misalignments.
• Writing specific English explanations detailing what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Explain findings clearly

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will conduct live conversations with AI voice models, compare image and video outputs, and explain in writing what looked off or misaligned with prompts.

Responsibilities include rating outputs across adherence, quality, and realism, then providing concise explanations. This role shapes how frontier AI systems reason and improve in practice.