AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Iqaluit; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Remote work

Weekly payments

Free access to LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you help shape how advanced AI systems reason and learn. You’ll compare AI outputs, spot artifacts, and write concise explanations in English highlighting reasons for judgments.

Qualifications

• Fluent English speaker with clear writing and speech.
• Excellent attention to detail and thorough review skills.
• Ability to think on your feet and explain judgments clearly.
• Experience writing concise evidence-based reviews.
• Bachelor's degree or higher preferred.

Responsibilities

• Hold live conversations with AI voice models and assess responses.
• Compare AI-generated images and videos for prompt adherence.
• Spot issues like distortions, flickering, or audio-text mismatches.
• Provide written explanations in English describing your judgments.

Skills

Fluent English

Written communication

Attention to detail

Decision making

Explaining reviews

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you help shape how advanced AI systems reason and learn. You’ll compare AI outputs, spot artifacts, and write concise explanations in English highlighting reasons for judgments.