AI Response Evaluator — Remote & Flexible

Outlier; Waco (TX); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible schedule

Remote work

Free access to LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated media, and explain what looked off, all remotely on a self-paced schedule.

Come join a team shaping how frontier AI systems learn and improve. Earn up to $18 USD/hr, with flexible hours and weekly payments, plus free access to leading LLMs. Remote work from anywhere.

Qualifications

• Fluent English with clear, professional writing.
• Strong attention to detail and careful listening/observation.
• Able to think on your feet and describe reasoning clearly.
• Experience writing concise, evidence-based reviews or explanations.
• Comfortable making a clear decision when options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judging adherence to prompts.
• Inspect outputs closely to spot issues like artifacts or mismatches and describe them in writing.
• Rate outputs across dimensions and provide a written explanation of findings.

Skills

Fluent English

Attention to detail

Spoken reasoning

Written explanations

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated media, and explain what looked off, all remotely on a self-paced schedule.

Come join a team shaping how frontier AI systems learn and improve. Earn up to $18 USD/hr, with flexible hours and weekly payments, plus free access to leading LLMs. Remote work from anywhere.