Remote AI Evaluator - Flexible Hours, Earn up to $18/hr

Outlier; Jacksonville (FL); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Additional incentives

Job summary

Outlier is recruiting detail-oriented English speakers to review AI-generated media remotely and on flexible hours. You will role-play live conversations with AI voice models, evaluate whether outputs follow prompts, and write precise English explanations of what looked or sounded off.

Responsibilities include comparing images and videos, testing video captions, and rating outputs across adherence, quality, and realism while working from home with weekly payments and access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail; patient and able to replay or zoom in to spot issues.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining choices in real conversations.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models, then rank how natural, useful, and clear each one sounds.
• Compare pairs of AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely (zoom/replay) to spot issues like distorted anatomy, flickering, text errors, or audio-video misalignment.
• Rate each output across dimensions (adherence, quality, realism) and write a specific explanation in English.

Skills

Fluent English

Attention to detail

Written communication

Response explanations

Education

Bachelor’s degree or above

Job description

Outlier is recruiting detail-oriented English speakers to review AI-generated media remotely and on flexible hours. You will role-play live conversations with AI voice models, evaluate whether outputs follow prompts, and write precise English explanations of what looked or sounded off.

Responsibilities include comparing images and videos, testing video captions, and rating outputs across adherence, quality, and realism while working from home with weekly payments and access to leading LLMs.