Remote AI Evaluator (Voice & Media)

Scale AI; Aurora; Remote; CAD 21,000 - 35,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to help train AI models by providing live evaluations of voice, image, and video outputs. This remote, freelance role offers flexible hours and the chance to contribute to cutting-edge AI research.

You’ll rank naturalness and clarity, compare AI outputs, and write concise explanations in English. A bachelor’s degree or higher and strong written communication are preferred; training screenings will apply.

Qualifications

• Fluent English with strong written communication and ability to discuss everyday conversational speech clearly.
• Bachelor’s degree or higher is preferred.
• Strong attention to detail and patience to replay/zoom in when something seems off.
• Ability to think on your feet and explain reasoning in a natural, conversational way.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images/videos and judging adherence to the prompt.
• Inspecting outputs closely for distortions, flickering, text errors, and audio-video mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Bachelor's degree

Attention to detail

Clear communication

Evidence-based explanations

Decision making

Education

Bachelor’s degree or higher

Job description

Outlier is seeking detail-oriented English speakers to help train AI models by providing live evaluations of voice, image, and video outputs. This remote, freelance role offers flexible hours and the chance to contribute to cutting-edge AI research.

You’ll rank naturalness and clarity, compare AI outputs, and write concise explanations in English. A bachelor’s degree or higher and strong written communication are preferred; training screenings will apply.