Remote AI Evaluation Specialist (Flexible Hours)

Scale AI; Richmond Hill; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare AI-generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This is a freelance/1099 opportunity, offering flexible hours and weekly payments through

Qualifications

• Fluent English with strong written communication.
• Patience to review and replay outputs carefully.
• Ability to explain what looked or sounded wrong in writing.
• Comfort making clear decisions when options have flaws.
• Bachelor’s degree or above is a plus.

Responsibilities

• Hold live, English conversations with AI voice models and rate naturalness.
• Compare AI-generated images and videos, judging adherence to prompts.
• Inspect outputs closely to spot problems like distortions or misalignment.
• Write concise explanations in English detailing observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making in ambiguous scenarios

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare AI-generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This is a freelance/1099 opportunity, offering flexible hours and weekly payments through