Remote English AI Quality Evaluator

Outlier; Overland Park (KS); Remote; USD 17,000 - 21,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off to help improve AI performance.

Ideal candidates have strong written communication, high attention to detail, and are comfortable deciding between imperfect options. Applicants from multiple countries are welcome.

Qualifications

• Fluent English speaker with clear written communication.
• Patience to look and listen closely, and to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely—zooming in or replaying—to spot problems like distorted anatomy, flickering, text errors, or audio-video mismatches.
• Rating each output on dimensions like adherence, quality, and realism, then writing a concise explanation in English.

Skills

Fluent English

Attention to detail

Written explanations

Clear communication

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off to help improve AI performance.

Ideal candidates have strong written communication, high attention to detail, and are comfortable deciding between imperfect options. Applicants from multiple countries are welcome.