AI Media Evaluator — Remote, Flexible Hours, Up to $18/hr

Outlier; Memphis (TN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible, remote schedule

Free access to leading LLMs

Missions surge incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote basis. You will roleplay conversations with AI voice models, compare outputs, and explain what looks off, helping advance AI systems in real-world use.

Responsibilities include evaluating images, videos, and audio, rating across multiple dimensions, and providing written justification in clear, concise English. Remote hours and weekly payments offered.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a bachelor’s degree or above.
• Able to think on your feet and explain things clearly in natural conversation.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank how natural and clear they sound.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely—zoom in, replay, and spot issues like distorted anatomy, flickering, text errors, or audio-video misalignment.
• Write a specific, English-language explanation of what you saw or heard to justify your rating.

Skills

Fluent English

Attention to detail

Fast thinking on your feet

Ability to write concise explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote basis. You will roleplay conversations with AI voice models, compare outputs, and explain what looks off, helping advance AI systems in real-world use.

Responsibilities include evaluating images, videos, and audio, rating across multiple dimensions, and providing written justification in clear, concise English. Remote hours and weekly payments offered.