Remote AI Quality Evaluator – Flexible Hours

Outlier; New York (NY); Remote; USD 17,000 - 24,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve. This is a freelance 1099 contract with weekly payments; rates vary by expertise and project needs, and

Qualifications

• Fluent English with strong, clear written communication.
• High attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and discussing realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each exchange sounded.
• Comparing pairs of AI-generated images and videos and judging which followed the prompt more closely.
• Inspecting outputs closely (zooming in, replaying) to spot problems like distorted anatomy, flickering or mismatched audio.
• Rating outputs across dimensions like adherence, quality, and realism, and providing a written English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Explanations writing

Decisive thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve. This is a freelance 1099 contract with weekly payments; rates vary by expertise and project needs, and