AI Response Rater — Remote, Flexible Evaluations

Outlier; Indianapolis (IN); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs by adherence to prompts, and explain in writing what looked or sounded off, all remotely on your own schedule.

We value precision and clear communication as you help shape AI systems to perform better in real-world settings. Flexible hours and remote work are offered with competitive hourly pay.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and patience to review outputs.
• Pursuing or holding a Bachelor's degree or above is a plus.
• Able to think on your feet and explain reasoning clearly.
• Experience writing brief, evidence-based reviews.

Responsibilities

• Holding live conversations with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated images and videos and judging prompt fidelity.
• Inspecting outputs closely to spot artifacts, flicker, or misalignment.
• Writing concise explanations in English detailing what was observed.

Skills

Fluent English

Attention to detail

Clear written explanations

Decision making under ambiguity

Quick thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs by adherence to prompts, and explain in writing what looked or sounded off, all remotely on your own schedule.

We value precision and clear communication as you help shape AI systems to perform better in real-world settings. Flexible hours and remote work are offered with competitive hourly pay.