AI Quality Evaluator — Remote, Flexible Hours

Outlier Ai; Sheffield; Remote; GBP 13,000 - 18,000; Part time

Benefits offered by this job

Flexible work

Self-paced schedule

Free LLM access

Global expert community

Pre-release projects

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score responses, and compare AI-generated images and videos to determine which adheres best to the prompt.

You will write concise explanations of issues found, all on your own schedule. This freelance/independent contractor role offers flexible hours with a weekly pay cycle.

Qualifications

• Fluent English with strong written communication.
• High attention to detail and ability to replay/zoom in on content.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs for issues like distorted visuals, flickering, or misaligned audio; document findings.
• Provide written explanations pinpointing what was observed and why the judgment was made.

Skills

Fluent English

Attention to detail

Communicating clearly

Evidence-based reviews

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier invites detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score responses, and compare AI-generated images and videos to determine which adheres best to the prompt.

You will write concise explanations of issues found, all on your own schedule. This freelance/independent contractor role offers flexible hours with a weekly pay cycle.