AI Media Quality Evaluator — Remote & Flexible Hours

Outlier; Arlington (TX); Remote; USD 20,000 - 29,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain in writing what looked or sounded off, all remotely and on your schedule.

We offer payment at up to $18 USD per hour, weekly via ACH, PayPal, or AirTM, and free access to leading LLMs. This role supports flexible, remote work and contributes to improving AI systems in real-world use.

Qualifications

• Fluent English with strong written communication and natural conversational speech.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Bachelor's degree or higher preferred.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide clearly when options have flaws.
• Currently accepting applicants from Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Hold live conversations with AI voice models and rank how natural, useful, and clear each one sounded.
• Compare pairs of AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely (zooming, replaying) to spot problems like distorted anatomy, flickering, or mismatched audio.
• Provide written explanations highlighting observed issues in English.
• Rate outputs across dimensions such as adherence, quality, and realism.

Skills

Fluent English

Clear written communication

Attention to detail

Clear decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain in writing what looked or sounded off, all remotely and on your schedule.

We offer payment at up to $18 USD per hour, weekly via ACH, PayPal, or AirTM, and free access to leading LLMs. This role supports flexible, remote work and contributes to improving AI systems in real-world use.