Remote AI Media Evaluator — Review & Rate Outputs

Outlier; Colorado Springs (CO); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on your own schedule. You will roleplay live conversations with an AI voice model, rate outputs for naturalness, usefulness and clarity, and explain in writing what looked or sounded off.

We offer remote work with flexible hours and weekly payments. Free access to leading LLMs, plus performance incentives. Your expertise helps shape AI systems used in real-world applications.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in when needed.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise explanations or reviews.
• Ability to decide clearly when options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images/videos and judging adherence to prompts.
• Inspecting outputs to spot issues like distortions, flickering, or audio/video mismatches.
• Providing written explanations in English citing what was observed.

Skills

Fluent English

Attention to detail

Decision making under ambiguity

Clear written explanations

Adaptable / fast thinker

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on your own schedule. You will roleplay live conversations with an AI voice model, rate outputs for naturalness, usefulness and clarity, and explain in writing what looked or sounded off.

We offer remote work with flexible hours and weekly payments. Free access to leading LLMs, plus performance incentives. Your expertise helps shape AI systems used in real-world applications.