Remote AI Media Evaluator: Spot & Rate Outputs

Outlier; Miami (FL); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible scheduling

Free access to leading LLMs

Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate outputs from live conversations with AI voice models. You will compare image and video pairs, judge adherence to prompts, and write concise explanations of what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluations shape how frontier AI systems reason and learn. Enjoy flexible hours, paid weekly, and free access to leading LLMs as part of the role.

Qualifications

• Fluent English with strong written communication skills.
• Excellent attention to detail and the ability to replay or zoom in to spot issues.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking how natural, useful, and clear they sound.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs to spot distortions, flicker, or misalignment and writing explanations in English that point to issues.
• Rating outputs across dimensions like adherence, quality, and realism and providing written justifications.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable thinking on your feet

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate outputs from live conversations with AI voice models. You will compare image and video pairs, judge adherence to prompts, and write concise explanations of what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluations shape how frontier AI systems reason and learn. Enjoy flexible hours, paid weekly, and free access to leading LLMs as part of the role.