Remote AI Evaluator: Spot AI Media Flaws & Improve Systems

Outlier; Gilbert (AZ); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments

Free access to LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, holding live conversations with an AI voice model, and scoring exchanges to explain what looked or sounded off, remotely and on your own schedule.

You'll compare AI-generated images and videos to judge which follows prompts more accurately, inspect outputs closely for errors, and write concise explanations in English that highlight what you saw or heard.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Bachelor's degree or higher is a plus.
• Able to think on your feet and explain decisions clearly.

Responsibilities

• Holding live, scenario-based conversations with AI voice models in English.
• Ranking naturalness and usefulness of responses.
• Comparing AI-generated images and videos to assess prompt adherence.
• Inspecting outputs for distorted anatomy, flickering, or misalignment.
• Writing concise, evidence-based explanations in English describing issues.

Skills

Fluent English

Attention to detail

Bachelor's degree or above (nice to)

Clear written explanations

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, holding live conversations with an AI voice model, and scoring exchanges to explain what looked or sounded off, remotely and on your own schedule.

You'll compare AI-generated images and videos to judge which follows prompts more accurately, inspect outputs closely for errors, and write concise explanations in English that highlight what you saw or heard.