Remote English AI Evaluation Specialist

Scale AI; Fort Saskatchewan; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Job summary

Outlier, operating under Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness, and describe issues with supporting explanations.

The role is remote and freelance, with weekly payouts and incentives based on project performance. Applicants from multiple countries can apply, including Canada and the United States.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in on content.
• Comfortable thinking on your feet and speaking through realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when multiple options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness.
• Compare AI-generated images/videos and judge which follows the prompt better.
• Inspect outputs closely to spot problems like distortions or mismatches and describe findings in English.
• Write a focused explanation citing what you saw or heard, with examples.

Skills

Fluent English

Attention to detail

Conversational thinking

Clear decision making

Strong written communication

Education

Bachelor’s degree or above

Job description

Outlier, operating under Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness, and describe issues with supporting explanations.

The role is remote and freelance, with weekly payouts and incentives based on project performance. Applicants from multiple countries can apply, including Canada and the United States.