AI Media Evaluator — Live English Rater (Remote)

Outlier; Greater London; Remote; GBP 13,000 - 18,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments

Free access to LLMs

Job summary

Outlier is hiring remote evaluators to review AI-generated media, scoring conversations with AI voice models and comparing image/video pairs to judge adherence to prompts. You will write concise explanations in English about what was off and how it could be improved.

This is a flexible, remote, freelance role with pay up to $15 per hour. Projects are weekly, with payments via common methods, and access to leading LLMs as part of the job. Applicants from multiple countries are welcome.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely (zooming in and replaying) to spot problems like distorted anatomy, flickering, text errors, and audio-video mismatch.
• Rating outputs across dimensions like adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree

Job description

Outlier is hiring remote evaluators to review AI-generated media, scoring conversations with AI voice models and comparing image/video pairs to judge adherence to prompts. You will write concise explanations in English about what was off and how it could be improved.

This is a flexible, remote, freelance role with pay up to $15 per hour. Projects are weekly, with payments via common methods, and access to leading LLMs as part of the job. Applicants from multiple countries are welcome.