Remote AI Output Quality Evaluator

Outlier; Cape Coral (FL); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and judge which outputs better follow prompts, then explain in writing what looked or sounded wrong, all remotely.

At Outlier, your work helps shape how AI systems reason and learn, turning frontier research into practical improvements for real-world performance.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and careful listening.
• Ability to explain findings clearly in English.
• Comfortable reasoning through scenarios and making decisions with flaws.
• Bachelor's degree or higher is preferred.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank naturalness and usefulness of outputs and follow prompts.
• Compare AI-generated images/videos and judge adherence to prompts.
• Provide written explanations of issues observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Adaptability

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and judge which outputs better follow prompts, then explain in writing what looked or sounded wrong, all remotely.

At Outlier, your work helps shape how AI systems reason and learn, turning frontier research into practical improvements for real-world performance.