Remote AI Quality Rater (English) — Flexible Hours

Outlier; Newark (NJ); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Earn up to $15/hr

Flexible hours

Remote work

LLM access

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and explaining what looked or sounded off, all remotely and on your own schedule.

You will compare AI-generated images and videos to judge how well they follow prompts, inspect outputs for distortions or misalignment, and write concise explanations in English.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.

Responsibilities

• Holding live, scenario-based conversations with AI voice models in English and ranking how natural and clear each response sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, misalignment, or mismatched audio.
• Rating outputs across dimensions and writing concise explanations in English detailing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Fast thinker

Evidence-based writing

Decisive under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and explaining what looked or sounded off, all remotely and on your own schedule.

You will compare AI-generated images and videos to judge how well they follow prompts, inspect outputs for distortions or misalignment, and write concise explanations in English.