Remote AI Evaluation Specialist

Outlier; Scottsdale (AZ); Hybrid; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work from home

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looks or sounds off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve through evaluation and feedback. This freelance opportunity offers flexible hours and weekly payments.

Qualifications

• Fluent English with clear, written communication.
• Strong attention to detail and ability to explain observations clearly.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank and compare AI-generated images and videos for prompt adherence.
• Inspect outputs closely to spot issues like artifacts, abnormal motion, or audio-text mismatches.
• Rate outputs on adherence, quality, and realism and provide written explanations.

Skills

Fluent English

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looks or sounds off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve through evaluation and feedback. This freelance opportunity offers flexible hours and weekly payments.