AI Media Quality Evaluator - Remote & Flexible Hours

Outlier; Norfolk (VA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare AI-generated images and videos, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve, with evaluation feedback turning frontier research into real-world AI performance. Flexible hours and remote work are offered.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Able to think on your feet and explain decisions clearly during reviews.
• Experience writing concise, evidence-based explanations or reviews.
• Applicants from multiple countries (US, UK, Canada, Ireland, Australia) are welcome.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English. Rank naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge which better follows prompts.
• Inspect outputs closely (zoom/replay) to spot problems like artifacts or misalignment.
• Provide a written explanation in English detailing what you saw or heard and why it mattered.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational English

Think on your feet

Education

Bachelor's degree or higher (preferred)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare AI-generated images and videos, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve, with evaluation feedback turning frontier research into real-world AI performance. Flexible hours and remote work are offered.