Remote AI Evaluation Specialist

Scale AI; Kentville; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global community of experts

Job summary

Outlier, powered by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay scenarios with an AI voice model, score exchanges, and explain discrepancies in writing, all remotely with flexible scheduling.

Ideal candidates are fluent in English, highly detail-oriented, and able to make clear decisions when faced with imperfect options. This is a contract opportunity with pay per hour and weekly payouts.

Qualifications

• Fluent English speaker with strong written communication skills.
• Excellent attention to detail and the ability to replay or zoom in to verify issues.
• Comfortable thinking on your feet and explaining reasoning clearly.
• Experience writing concise, evidence-based reviews or explanations.
• Able to decide clearly when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge which better follows the prompt.
• Inspect outputs closely (zoom, replay) to spot issues like distorted anatomy, flickering, or misaligned audio/video.
• Provide a written explanation in English detailing what you observed and why.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Evidence-based writing

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, powered by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay scenarios with an AI voice model, score exchanges, and explain discrepancies in writing, all remotely with flexible scheduling.

Ideal candidates are fluent in English, highly detail-oriented, and able to make clear decisions when faced with imperfect options. This is a contract opportunity with pay per hour and weekly payouts.