Remote AI Media Evaluator - Spot Errors & Improve Models

Outlier; Arlington (VA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Incentives via Missions

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Tasks include comparing AI-generated images and videos to prompts, identifying issues such as artifacts or misalignment, and rating outputs across dimensions like adherence and realism.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and the ability to replay or zoom in to verify outputs.
• Bachelor's degree or higher is preferred.
• Ability to think quickly and explain decisions clearly when options have flaws.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which aligns with prompts.
• Inspect outputs closely (zoom/replay) to identify errors like distorted motion, text errors, or audio-video mismatch.
• Provide a written explanation of findings for each task, citing observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision-making under ambiguity

Experience writing explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Tasks include comparing AI-generated images and videos to prompts, identifying issues such as artifacts or misalignment, and rating outputs across dimensions like adherence and realism.