Remote AI Media Evaluator — Image, Video & Audio QA

Outlier; Seattle (WA); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-focused English speakers to review AI-generated media. You’ll role-play live conversations with AI voice models and rate how well exchanges respect prompts, remotely and on your own schedule.

You will compare AI-generated images and videos, inspect outputs for distortions or mismatches, and explain in writing what looked off.

Ideal candidates have fluent English, strong written communication, and a Bachelor’s degree or higher; US-based applicants are welcome.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to verify issues.
• Bachelor's degree or higher preferred.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank how natural and clear each exchange sounds.
• Compare pairs of AI-generated images and videos and judge which follows the prompt more closely.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or mismatches between audio and video.
• Explain in writing what looked or sounded wrong with specific observations.
• Image evaluations: compare two AI-generated images for the same text prompt and judge adherence and quality.
• Video evaluations: rank AI-generated videos against a text prompt or original clip.
• Video caption labeling: write precise captions from AI drafts and improve accuracy.
• Audio and voice evaluations: rate speech naturalness and how closely it matches a target voice.

Skills

Fluent English

Written communication

Attention to detail

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-focused English speakers to review AI-generated media. You’ll role-play live conversations with AI voice models and rate how well exchanges respect prompts, remotely and on your own schedule.

You will compare AI-generated images and videos, inspect outputs for distortions or mismatches, and explain in writing what looked off.

Ideal candidates have fluent English, strong written communication, and a Bachelor’s degree or higher; US-based applicants are welcome.