Remote AI Evaluation Specialist

Outlier; Manchester (NH); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly pay

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare image and video pairs, and explain in writing what looked or sounded wrong. This is remote and on your schedule, with access to leading LLMs included.

Contributors help shape AI systems by providing timely feedback and evaluations, earning up to $15/hour plus incentives while working from anywhere.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and careful review of outputs.
• Ability to explain in writing what looked or sounded off.
• Comfortable making clear decisions when options have flaws.
• Bachelor’s degree or higher is a plus, not required.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated image and video pairs and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distortion, flicker, and misalignment.
• Writing specific explanations in English that point to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Explain in writing

Decision making under ambiguity

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare image and video pairs, and explain in writing what looked or sounded wrong. This is remote and on your schedule, with access to leading LLMs included.

Contributors help shape AI systems by providing timely feedback and evaluations, earning up to $15/hour plus incentives while working from anywhere.