Remote AI Quality Evaluator — Spot Gaps & Explain

Outlier; Hamilton; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments (ACH/PayPal)

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models and score exchanges, comparing images and videos to determine which follows prompts more accurately, and explain findings in writing.

Ideal candidates have strong attention to detail, excellent written English, and a Bachelor’s or higher.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to review outputs closely.
• Ability to explain findings succinctly in writing.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking how natural, useful, and clear each exchange sounds.
• Comparing AI-generated images and videos to judge prompt adherence.
• Judging which output follows the prompt more closely.
• Inspecting outputs to spot issues like distorted anatomy, flickering, or misaligned audio.
• Rating outputs on adherence, quality and realism and writing explanations.

Skills

Fluent English

Attention to detail

Clear written communication

Adaptability

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models and score exchanges, comparing images and videos to determine which follows prompts more accurately, and explain findings in writing.

Ideal candidates have strong attention to detail, excellent written English, and a Bachelor’s or higher.