AI Media Evaluator — Remote, Flexible Hours + Free LLM Access

Outlier; Savannah (GA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Hourly pay up to $18

Flexible remote hours

Free access to leading LLMs

Missions incentive

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked off or sounded odd, all remotely and on your own schedule.

You will compare AI-generated images and videos to prompts, identify issues such as distorted motion, misalignment of audio, and artifacts, and provide concise explanations to help improve AI systems.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.
• Bachelor’s degree or higher is preferred.

Responsibilities

• Holding live, scenario-based conversations with AI voice models in English and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to prompts and judging prompt adherence.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or audio/video misalignment.
• Rating outputs across dimensions and writing specific English explanations of observations.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Review writing experience

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked off or sounded odd, all remotely and on your own schedule.

You will compare AI-generated images and videos to prompts, identify issues such as distorted motion, misalignment of audio, and artifacts, and provide concise explanations to help improve AI systems.