Remote AI Evaluation Specialist (Freelance)

Scale AI; Saint-Eustache; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Join 900K+ Outlier Experts across 52+%

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and evaluate live conversations with AI voice models. You will rank naturalness, compare images/videos, and write concise explanations of observed issues, all on your own schedule and remotely.

As part of Outlier, you will help shape AI reasoning and performance by providing structured feedback. This freelance, 1099 role offers weekly payments and additional incentives based on project metrics.

Qualifications

• Strong attention to detail and written communication skills.
• Ability to explain decisions with concise, evidence-based reasoning.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models, rank naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like artifacts, distortion, or misalignment between audio and video.
• Provide written explanations pointing to observed issues and rationale in English.

Skills

Attention to detail

Clear written communication

English fluency

Decision making

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and evaluate live conversations with AI voice models. You will rank naturalness, compare images/videos, and write concise explanations of observed issues, all on your own schedule and remotely.

As part of Outlier, you will help shape AI reasoning and performance by providing structured feedback. This freelance, 1099 role offers weekly payments and additional incentives based on project metrics.