AI Evaluation Specialist — Remote & Flexible

Outlier; Burlington (VT); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work

1099 contract

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere on your own schedule. You will roleplay live conversations with an AI voice model, score exchanges, compare image and video outputs, and explain what looked or sounded off in writing.

Work remotely with flexible hours and weekly payments. Earn up to $15 USD per hour with additional incentives, and gain free access to leading language models to aid your evaluations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to explain issues precisely.
• Comfortable discussing realistic scenarios in natural language.
• Bachelors degree or higher preferred.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness and usefulness.
• Compare pairs of AI-generated images and videos for prompt adherence.
• Inspect outputs closely to spot artifacts and misalignments.
• Write concise, evidence-based explanations in English detailing findings.

Skills

Fluent English

Written communication

Attention to detail

Decision making under ambiguity

Clear explanations

Evidence-based reviews

Education

Bachelors degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere on your own schedule. You will roleplay live conversations with an AI voice model, score exchanges, compare image and video outputs, and explain what looked or sounded off in writing.

Work remotely with flexible hours and weekly payments. Earn up to $15 USD per hour with additional incentives, and gain free access to leading language models to aid your evaluations.