Remote English Model Quality Evaluator

Outlier (by Scale AI); City Of London; Remote; GBP 13,000 - 18,000; Full time

Benefits offered by this job

Flexible schedule

Free AI tools access

Global expert community

Collaborative projects

Job summary

Outlier (by Scale AI) is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

You'll compare AI-generated images and videos to prompts, rate outputs for adherence and realism, and provide concise, evidence-based explanations. Flexible hours, weekly pay, and access to leading LLMs are part of the program.

Qualifications

• Fluent English speaker with strong, clear written communication
• Strong attention to detail and patience to replay or zoom in when something seems off
• Experience writing short, evidence-based explanations or reviews
• Ability to make a clear decision when both options have flaws
• Nice to have: pursuing or holding a Bachelor's degree or above

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches
• Writing a specific explanation in English that points to what was seen or heard and why a choice was made

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier (by Scale AI) is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

You'll compare AI-generated images and videos to prompts, rate outputs for adherence and realism, and provide concise, evidence-based explanations. Flexible hours, weekly pay, and access to leading LLMs are part of the program.