AI Evaluation Specialist - Remote & Flexible Hours

Outlier; Asheville (NC); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier offers a remote, flexible contracting role that invites you to review AI-generated media by engaging in live conversations with AI voice models. You will assess how well responses follow prompts, compare image/video pairs, and explain findings in writing from home on a schedule that suits you.

Ideal candidates are fluent in English, detail-oriented, and able to produce concise, evidence-based explanations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in.
• Bachelor's degree or higher preferred.
• Able to articulate observations in writing.

Responsibilities

• Holding live scenario-based conversations in English with AI voice models, rating naturalness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs to spot problems like artifacts, distortions, or audio-video mismatches.
• Rating outputs across dimensions and providing written explanations.

Skills

Fluent English

Attention to detail

Clear written communication

Concise explanations

Education

Bachelor's degree or above

Job description

Outlier offers a remote, flexible contracting role that invites you to review AI-generated media by engaging in live conversations with AI voice models. You will assess how well responses follow prompts, compare image/video pairs, and explain findings in writing from home on a schedule that suits you.

Ideal candidates are fluent in English, detail-oriented, and able to produce concise, evidence-based explanations.