Remote AI Output Evaluator & Quality Reviewer

Scale AI; Surrey; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Free access to leading LLMs

Weekly payments

Flexible schedule

Missions incentives

Job summary

Outlier, an AI evaluation platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will assess naturalness, usefulness, and clarity across tasks, including image/video comparison and caption labeling.

As a remote contractor, you can set your own schedule and earn up to $15 per hour, with additional incentives from Missions. Applicants from multiple countries, including Canada, are welcome to apply.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail, with patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic scenarios in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like distorted anatomy or mismatched audio and video.
• Write specific explanations in English detailing what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Writing concise explanations

Education

Bachelor’s degree or higher

Job description

Outlier, an AI evaluation platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will assess naturalness, usefulness, and clarity across tasks, including image/video comparison and caption labeling.

As a remote contractor, you can set your own schedule and earn up to $15 per hour, with additional incentives from Missions. Applicants from multiple countries, including Canada, are welcome to apply.