Remote AI Media Evaluator — English, Flexible Hours

Outlier; Columbus (OH); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Paid weekly

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of home on a flexible schedule. You will engage in live conversations with AI voice models, compare generated media, and provide written explanations of what’s off, helping improve AI systems in real-world scenarios.

You’ll evaluate images, videos, and audio, detailing issues such as misalignment, artifacts, or unnatural motion, and rate each output on multiple dimensions.

Qualifications

• Fluent English speaker with clear written communication and comfortable with natural conversational speech.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor’s degree or above.
• Able to think on your feet and discuss realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which followed the prompt better.
• Inspecting outputs closely (zooming in/replaying) to spot problems like distorted anatomy, flickering, text errors, or misaligned audio.
• Rating outputs across dimensions like adherence, quality and realism, then writing a concise English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Decisions under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of home on a flexible schedule. You will engage in live conversations with AI voice models, compare generated media, and provide written explanations of what’s off, helping improve AI systems in real-world scenarios.

You’ll evaluate images, videos, and audio, detailing issues such as misalignment, artifacts, or unnatural motion, and rate each output on multiple dimensions.