Remote AI Evaluation Specialist

Outlier Ai; Southampton; Remote; GBP 13,000 - 18,000; Full time

Benefits offered by this job

Flexible schedule

Weekly payments

Remote work in the UK

Access to leading LLMs

Surge incentives

Job summary

Outlier is an AI training platform owned and operated by Scale AI and is seeking detail-oriented English speakers to review AI-generated media from a remote location in the United Kingdom. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all on your own schedule.

As an Outlier Expert, you will evaluate prompts, images, and videos, with weekly payments and opportunities for additional incentives.

Qualifications

• Fluent English speaker with clear written communication.
• Very good attention to detail and patience to look and listen closely.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Willingness to make clear decisions even when each option has flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear thinking on feet

Evidence-based reviews

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is an AI training platform owned and operated by Scale AI and is seeking detail-oriented English speakers to review AI-generated media from a remote location in the United Kingdom. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all on your own schedule.

As an Outlier Expert, you will evaluate prompts, images, and videos, with weekly payments and opportunities for additional incentives.