AI Media Evaluator — Remote, Flexible Hours + Free LLM Access

Outlier; Charlottesville (VA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will participate in live conversations with AI voice models, compare AI-produced images and videos, and explain misalignments in writing.

Your role helps improve how AI systems reason and respond to prompts in real-world settings. Responsibilities include rating outputs, identifying issues like visual distortions and audio-video mismatches, and providing concise explanations.

Qualifications

• Fluent English with strong written communication and comfort with everyday conversational speech.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Ability to think clearly and decide when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely (zoom/replay) to spot problems like distorted visuals or mismatched audio.
• Write a concise English explanation highlighting what was observed and why a choice was made.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will participate in live conversations with AI voice models, compare AI-produced images and videos, and explain misalignments in writing.

Your role helps improve how AI systems reason and respond to prompts in real-world settings. Responsibilities include rating outputs, identifying issues like visual distortions and audio-video mismatches, and providing concise explanations.