Remote AI Evaluation Specialist — Freelance

Outlier; Alaska; Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Remote work flexibility

Community of 900K+ Outlier Experts

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and provide written explanations. You will compare images and videos to judge prompt adherence and explain issues in clear English from a remote location.

Flexibility to set your own schedule is offered, with freelance/independent contractor status. Prior experience in evaluation tasks is helpful, and a Bachelor’s degree or higher is a plus.

Qualifications

• Must be fluent in English with strong written communication.
• Experience writing brief, evidence-based reviews.
• Detail-oriented with ability to spot inconsistencies.
• Familiarity with AI model evaluation tasks is a plus.

Responsibilities

• Hold live English conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Write concise, evidence-based explanations in English detailing issues.
• Collaborate with the Outlier community to improve evaluation processes.

Skills

Fluent English

Written communication

Attention to detail

Decision making

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and provide written explanations. You will compare images and videos to judge prompt adherence and explain issues in clear English from a remote location.

Flexibility to set your own schedule is offered, with freelance/independent contractor status. Prior experience in evaluation tasks is helpful, and a Bachelor’s degree or higher is a plus.