Remote AI Quality Evaluator - Flexible Hours

Outlier; Summerside; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs closely, and rating adherence, quality, and realism with concise explanations in English.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to review carefully.
• Bachelor's degree or above preferred.
• Able to think on your feet and explain reasoning clearly.
• Experience writing concise, evidence-based explanations.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and rating naturalness and usefulness.
• Comparing pairs of AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or mismatched audio/video.
• Rating outputs across dimensions and writing a clear English explanation of observations.

Skills

Fluent English

Attention to detail

Clear written communication

Verbal reasoning

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs closely, and rating adherence, quality, and realism with concise explanations in English.