Remote AI Conversation Evaluator — English Speaker

Outlier; New Haven (CT); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work from anywhere

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely with flexible hours. You will converse with AI voice models, compare image/video outputs, and explain what’s off in writing.

Earn up to $15/hr plus incentives through an international remote program and paid weekly via ACH, PayPal, and AirTM. We welcome applicants from multiple countries, including the United States, with a 1099 contract structure and opportunities to earn additional incentives based on project

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in.
• Bachelor's degree or higher preferred.
• Able to think on your feet and discuss realistic situations.
• Experience writing short, evidence-based explanations or reviews.
• Capable of making clear decisions when two options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural and clear each utterance sounds.
• Comparing AI-generated images and videos and judging which follows the prompt.
• Inspecting outputs closely to spot problems like distortion, flicker, or misalignment.
• Rating outputs across dimensions and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear writing

Decision making

Adaptability

Evidence-based writing

Education

Bachelor's degree or higher (nice to have)

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely with flexible hours. You will converse with AI voice models, compare image/video outputs, and explain what’s off in writing.

Earn up to $15/hr plus incentives through an international remote program and paid weekly via ACH, PayPal, and AirTM. We welcome applicants from multiple countries, including the United States, with a 1099 contract structure and opportunities to earn additional incentives based on project