Remote AI Content Evaluator & Feedback Specialist

Outlier; Pittsburgh (Allegheny County); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to LLMs

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your schedule.

You’ll help shape how advanced AI systems reason and learn by providing evaluation feedback. This is a flexible, freelance contract with remote work and weekly payments.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Bachelor's degree or above preferred.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, spotting issues like distorted anatomy, flickering, or misalignment between audio and video.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation explaining what you observed.

Skills

Fluent English

Attention to detail

Written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your schedule.

You’ll help shape how advanced AI systems reason and learn by providing evaluation feedback. This is a flexible, freelance contract with remote work and weekly payments.