Remote AI Media Evaluator: Image & Video Quality

Outlier; Pasadena (CA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work from home or while travel

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented evaluators to review AI-generated media. You will hold live conversations with AI voice models, score outputs for naturalness and adherence to prompts, and explain discrepancies in writing.

This is a fully remote, flexible-hours opportunity paying up to $15/hr, with weekly payments and access to leading LLMs. Ideal candidates are fluent English speakers with excellent written communication and sharp attention to detail.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and the patience to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each conversation sounded.
• Comparing AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, spotting problems like distorted anatomy, flickering or unlatural motion, text errors, and audio-video mismatches.
• Writing explanations in English that point to what you saw or heard, with specific details.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented evaluators to review AI-generated media. You will hold live conversations with AI voice models, score outputs for naturalness and adherence to prompts, and explain discrepancies in writing.

This is a fully remote, flexible-hours opportunity paying up to $15/hr, with weekly payments and access to leading LLMs. Ideal candidates are fluent English speakers with excellent written communication and sharp attention to detail.