AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Harrisburg (Dauphin County); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Free access to leading LLMs

Fully remote

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You will compare AI-generated images and videos, judge prompt adherence, and explain in writing what looked or sounded off, all on a flexible, fully remote schedule.

We provide access to leading LLMs, and earnings are project-based with weekly payments. This is a freelance, 1099 contract opportunity requiring authorization to work in your country of residence.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to review closely.
• Experience expressing concise explanations or reviews in writing.
• Comfortable deciding when one option has flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing pairs of AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely—zooming in and replaying to spot glitches like distorted anatomy, flickering, or audio mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English

Clear written communication

Attention to detail

Self-motivated

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You will compare AI-generated images and videos, judge prompt adherence, and explain in writing what looked or sounded off, all on a flexible, fully remote schedule.

We provide access to leading LLMs, and earnings are project-based with weekly payments. This is a freelance, 1099 contract opportunity requiring authorization to work in your country of residence.