Remote AI Media Evaluator — Spot Flaws & Improve Models

Outlier; Chicago (IL); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Freelance 1099 contract

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what looked or sounded wrong, all remotely and on your own schedule.

You will assess outputs for naturalness, relevance, and accuracy across audio, visual, and text, providing written explanations to help improve AI systems and their real-world performance.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing concise explanations or reviews.
• Ability to decide clearly when options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Independent scheduling

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what looked or sounded wrong, all remotely and on your own schedule.

You will assess outputs for naturalness, relevance, and accuracy across audio, visual, and text, providing written explanations to help improve AI systems and their real-world performance.