AI Media Evaluator: Remote, Flexible Hours, $18/hr

Outlier; Stamford (CT); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely. You will roleplay live conversations with AI voice models, score each exchange, and explain in writing what looked or sounded off.

This work helps shape how advanced AI systems reason and improve through Outlier’s evaluation loop. Contributors work on a flexible schedule from home or while traveling, with weekly payments.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in on AI outputs.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable evaluating AI-generated media and providing written feedback.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judging which adheres to the prompt better.
• Inspect outputs closely to spot problems like distortions, flicker, or misalignment between audio and video.
• Write a clear, English explanation describing what was observed and why a better option was selected.

Skills

Fluent English

Attention to detail

Clear written communication

Analytical thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely. You will roleplay live conversations with AI voice models, score each exchange, and explain in writing what looked or sounded off.

This work helps shape how advanced AI systems reason and improve through Outlier’s evaluation loop. Contributors work on a flexible schedule from home or while traveling, with weekly payments.