Remote AI Evaluation Specialist

Scale AI; Cambridge; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring naturalness and usefulness. You will compare AI-created images and videos to prompts and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include inspecting outputs for distortions or misalignments, rating across dimensions, and crafting precise explanations.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to articulate observations clearly in writing.
• Ability to think on your feet and discuss realistic scenarios fluently.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like artifacts, flickering, or audio-text mismatches and describe findings in writing.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational speaking

Evidence-based reviews

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring naturalness and usefulness. You will compare AI-created images and videos to prompts and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include inspecting outputs for distortions or misalignments, rating across dimensions, and crafting precise explanations.