Remote AI Evaluation Specialist - English, Flexible Hours

Outlier; Billings (MT); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly pay

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will hold live conversations with AI voice models, compare images and videos, and explain what’s off, all remotely on a flexible schedule.

You’ll rate outputs for adherence, quality, and realism, describe your reasoning in writing, and submit evaluations weekly for compensation up to $15 per hour. This freelance contract offers remote work and access to leading LLMs.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and patience to look and listen closely.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each one sounded.
• Comparing AI-generated images and videos and judging which adheres to the prompt better.
• Inspecting outputs closely to spot problems like distorted motion, text errors, or audio-video mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will hold live conversations with AI voice models, compare images and videos, and explain what’s off, all remotely on a flexible schedule.

You’ll rate outputs for adherence, quality, and realism, describe your reasoning in writing, and submit evaluations weekly for compensation up to $15 per hour. This freelance contract offers remote work and access to leading LLMs.