AI Media Evaluator — Remote & Flexible Hours

Outlier; Wilmington (DE); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible schedule

Free LLM access

Incentives (Missions)

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will participate in live conversations with AI voice models, evaluate how well outputs follow prompts, and provide written explanations of what looked off.

The role helps improve AI systems through systematic scoring and feedback. Contributors can work remotely from multiple countries, earning up to $18/hour with additional incentives and free access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Nice to have: pursuing or holding a Bachelor’s degree or above.
• Comfortable thinking on your feet and describing realistic situations.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness and clarity.
• Compare AI-generated images and videos to judge adherence to prompts.
• Inspect outputs closely to spot artifacts such as distorted anatomy, motion issues, or misalignment of audio and video.
• Provide written explanations in English detailing what was observed.

Skills

English fluency

Attention to detail

Clear written communication

Adaptability

Scenario-based evaluation

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will participate in live conversations with AI voice models, evaluate how well outputs follow prompts, and provide written explanations of what looked off.

The role helps improve AI systems through systematic scoring and feedback. Contributors can work remotely from multiple countries, earning up to $18/hour with additional incentives and free access to leading LLMs.