Remote AI Conversation Evaluator — English Speaker

Outlier; Cheyenne (WY); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Free access to leading LLMs

Weekly payments via ACH, PayPal andAir

Job summary

Outlier is hiring reviewers to engage in live conversations with AI voice models, compare AI-generated media against prompts, and explain what’s off in writing. Reviewers work remotely on a flexible schedule, with pay per project and weekly payments.

Applicants should be fluent in English, detail-oriented, and able to produce concise, evidence-based explanations. Contributors gain access to cutting-edge LLMs and participate in evaluations that help improve AI systems in real-world tasks, with

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail; ability to replay/zoom to spot issues.
• Experience writing short, evidence-based reviews or explanations.
• Comfortable making clear decisions when options have flaws.
• Nice to have a Bachelor's degree or higher.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking naturalness, usefulness, and clarity of responses.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely to spot distortions, flickering, or misalignment.
• Writing concise explanations in English pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making

Education

Bachelor's degree or above (nice to have)

Job description

Outlier is hiring reviewers to engage in live conversations with AI voice models, compare AI-generated media against prompts, and explain what’s off in writing. Reviewers work remotely on a flexible schedule, with pay per project and weekly payments.

Applicants should be fluent in English, detail-oriented, and able to produce concise, evidence-based explanations. Contributors gain access to cutting-edge LLMs and participate in evaluations that help improve AI systems in real-world tasks, with