Remote AI Media Evaluator — Voice & Video QA

Outlier; Amherst (MA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Weekly payments

Free LLM access

Flexible schedule

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models and scoring outputs for naturalness, usefulness, and clarity. You will compare AI-generated images and videos, judging which better follows prompts while describing what looked or sounded off in writing.

Responsibilities include inspecting outputs closely, including zooming in and replaying, and providing concise explanations in English that point to observed

Qualifications

• Fluent English with clear written communication and comfortable conversation.
• Strong attention to detail and patience to replay or zoom in on content.
• Bachelor’s degree or higher preferred.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live conversations in English with AI voice models and rank outputs by naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows the prompt more closely.
• Inspect outputs carefully to spot issues like glitches, misalignment, or audio-video mismatch.
• Write specific explanations in English detailing what you saw or heard and why it mattered.

Skills

Fluent English

Attention to detail

Bachelor's degree

Clear writing

Decision making

Adaptability

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models and scoring outputs for naturalness, usefulness, and clarity. You will compare AI-generated images and videos, judging which better follows prompts while describing what looked or sounded off in writing.

Responsibilities include inspecting outputs closely, including zooming in and replaying, and providing concise explanations in English that point to observed