Remote AI Conversation Evaluator - English Speaker

Outlier; Asheville (NC); Remote; USD 17,000 - 24,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score exchanges, compare generated images and videos for prompt adherence, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, contributing to better real-world AI performance through evaluation feedback.

Qualifications

• Fluent English with clear, written communication.
• Strong attention to detail; able to replay or zoom in to spot issues.
• Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining your reasoning in English.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each exchange sounded.
• Comparing AI-generated images and videos to judge which follows the prompt more closely.
• Writing a concise, evidence-based explanation of your judgments in English.

Skills

Fluent English

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score exchanges, compare generated images and videos for prompt adherence, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, contributing to better real-world AI performance through evaluation feedback.