Remote AI Evaluator: Live Conversations & Model Scoring

Scale AI; Vernon; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Join 900K+ Outlier Experts

Surge/incentive opportunities

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain any issues in writing.

You can work remotely on your own schedule, earning per-hour pay for project work with additional incentive opportunities. Contributors review images, videos, captions, and audio to judge adherence to prompts and quality, and to provide precise explanations of any observed discrepancies.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to inspect outputs.
• Ability to explain decisions clearly in English.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot problems like distortions or misalignment and explain findings in writing.
• Rate outputs across dimensions and provide written explanations.

Skills

Fluent English

Attention to detail

Clear written explanations

Decision making

Bachelor’s degree (nice)

Education

Bachelor’s degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain any issues in writing.

You can work remotely on your own schedule, earning per-hour pay for project work with additional incentive opportunities. Contributors review images, videos, captions, and audio to judge adherence to prompts and quality, and to provide precise explanations of any observed discrepancies.