Remote AI Quality Evaluator

Outlier; State College (Centre County); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free LLM access

Job summary

Outlier is recruiting detail-focused English speakers to review AI-generated media in a remote, flexible-hours setup. You will conduct live conversations with AI voice models, compare image and video pairs, and explain what’s off in clear, written notes.

Your work helps improve AI systems and contributes to high-quality data used in frontier research. Projects are freelance, paid weekly and offered with incentives.

Qualifications

• Fluent English speaker with strong written communication.
• Great attention to detail and the ability to replay or zoom in to spot issues.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing pairs of AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs for distortions, flicker, or misalignment, and noting issues in writing.
• Rating outputs on dimensions like adherence, quality, and realism and providing written explanations.

Skills

Fluent English

Attention to detail

Clear explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is recruiting detail-focused English speakers to review AI-generated media in a remote, flexible-hours setup. You will conduct live conversations with AI voice models, compare image and video pairs, and explain what’s off in clear, written notes.

Your work helps improve AI systems and contributes to high-quality data used in frontier research. Projects are freelance, paid weekly and offered with incentives.