Remote AI Media Evaluator: Spot Errors & Rate Prompts

Outlier; Providence (RI); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours from anywhere

Free access to leading LLMs

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain what’s off in writing, remotely and on your own schedule.

You’ll use your keen attention to detail to spot issues like artifacts, misalignment, or uncanny timing, and you’ll document findings in clear English. This flexible role supports ongoing AI evaluation work from anywhere.

Qualifications

• Fluent English with strong, clear written communication and comfortable with natural, everyday conversational speech.
• Strong attention to detail with patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic situations conversationally.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely (zoom/replay) to spot problems like distorted anatomy, flickering, text/audio mismatches.
• Rate outputs across dimensions (adherence, quality, realism) and write a concise English explanation.

Skills

Fluent English

Attention to detail

Think on your feet

Clear decision making

Evidence-based reviews

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain what’s off in writing, remotely and on your own schedule.

You’ll use your keen attention to detail to spot issues like artifacts, misalignment, or uncanny timing, and you’ll document findings in clear English. This flexible role supports ongoing AI evaluation work from anywhere.