Remote AI Conversation Evaluator — English Expert

Outlier; Kansas City (MO); Remote; USD 17,000 - 28,000; Full time

Benefits offered by this job

Competitive pay

Incentives

Flexible schedule

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos for prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Through Outlier's evaluation and feedback loop, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world AI performance enhancements.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and explain decisions clearly.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when options have flaws.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness and clarity of each one.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatch.
• Rating outputs on adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Clear written communication

Attention to detail

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos for prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Through Outlier's evaluation and feedback loop, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world AI performance enhancements.