Remote AI Conversation Evaluator (English Speaker)

Outlier; Columbia (MD); Remote; USD 12,000 - 21,000; Part time

Benefits offered by this job

Free access to leading LLMs

Fully remote

Flexible hours

Weekly payments (ACH/PayPal/AirTM)

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of home. You will conduct live conversations with AI voice models, compare image/video pairs, and explain what’s off in writing, remotely and on your own schedule.

This is a fully remote, flexible-hour contract opportunity paying up to $15/hour with weekly payments. You’ll have access to leading LLMs and work from anywhere, joining a growing team shaping AI evaluation workflows.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and ability to replay or zoom in on content.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a clear English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational thinking

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of home. You will conduct live conversations with AI voice models, compare image/video pairs, and explain what’s off in writing, remotely and on your own schedule.

This is a fully remote, flexible-hour contract opportunity paying up to $15/hour with weekly payments. You’ll have access to leading LLMs and work from anywhere, joining a growing team shaping AI evaluation workflows.