Remote AI Quality Rater – English

Outlier; Norman (OK); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Weekly payments

Access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to remotely review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded off, all on your own schedule.

You will compare AI-generated images and videos, judging which follows the prompt more accurately, and provide written explanations of the issues observed.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in to verify content.
• Experience writing short, evidence-based explanations or reviews is a plus.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, text errors, and audio-video mismatches.
• Rating each output across dimensions like adherence, quality, and realism, and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to remotely review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded off, all on your own schedule.

You will compare AI-generated images and videos, judging which follows the prompt more accurately, and provide written explanations of the issues observed.