Remote AI Evaluation Specialist — English Speaker

Outlier; Eugene (OR); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos to the prompt, and write clear explanations of what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason and improve. Your work supports turning frontier research into practical AI that performs better in the real world.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful listening.
• Bachelor’s degree or higher is desirable.
• Able to think on your feet and discuss realistic scenarios.
• Experience writing concise, evidence-based explanations.
• Comfortable choosing between options with flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank naturalness and usefulness of responses and explain findings in writing.
• Compare AI-generated images and videos to prompt guidelines and identify issues.
• Provide written explanations highlighting observed problems.

Skills

Fluent English

Attention to detail

Written communication

Comfortable thinking and explaining

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos to the prompt, and write clear explanations of what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason and improve. Your work supports turning frontier research into practical AI that performs better in the real world.