Remote AI Conversation Evaluator — English Speaker

Outlier; Salem (OR); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented contributors to review AI-generated media. You will hold live conversations with AI voice models, rank outputs, compare image/video pairs, and provide written explanations of what looked or sounded off.

This is a remote, flexible opportunity with pay per hour and incentives. Candidates from multiple markets can apply, including the United States, with payments weekly via ACH, PayPal, or AirTM.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Bachelor’s degree or higher is nice to have.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Capable of clear decision-making when options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank naturalness, usefulness, and clarity of responses.
• Compare AI-generated images and videos to assess adherence to prompts.
• Inspect outputs closely for distortions, flickering, or misaligned audio.
• Provide written explanations of observations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Speaking on your feet

Evidence-based writing

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented contributors to review AI-generated media. You will hold live conversations with AI voice models, rank outputs, compare image/video pairs, and provide written explanations of what looked or sounded off.

This is a remote, flexible opportunity with pay per hour and incentives. Candidates from multiple markets can apply, including the United States, with payments weekly via ACH, PayPal, or AirTM.