Remote AI Response Evaluator — Flexible Hours

Outlier; Chapel Hill (NC); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well generated outputs follow prompts. You will engage in live conversations with AI voice models, compare multimedia outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems learn and perform, with flexible hours and compensation that reflects expertise.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to think on your feet and explain decisions clearly.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distortions, flickering, or misalignment and describe them.
• Rate outputs across dimensions and write a specific English explanation pointing to what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Think on your feet

Evidence-based explanations

Independent working

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well generated outputs follow prompts. You will engage in live conversations with AI voice models, compare multimedia outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems learn and perform, with flexible hours and compensation that reflects expertise.