Remote English AI Evaluator

Scale AI; Longueuil; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Free LLM access

Global community

Job summary

Outlier is an AI evaluation platform seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Contributors compare AI-generated images and videos to prompts, rate adherence and quality, and provide concise explanations in writing. This freelance opportunity offers weekly payments and access to leading LLMs.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations in a natural, conversational way.
• Experience writing concise, evidence-based reviews.
• Able to make clear decisions when both options have flaws.
• Nice to have: Bachelor’s degree or above.

Responsibilities

• Hold a live, scenario-based English conversation with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio.
• Write a specific explanation in English pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decisiveness

Education

Bachelor’s degree (nice to have)

Job description

Outlier is an AI evaluation platform seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Contributors compare AI-generated images and videos to prompts, rate adherence and quality, and provide concise explanations in writing. This freelance opportunity offers weekly payments and access to leading LLMs.