Remote AI Language Evaluation Specialist

Scale AI; Whitby; Remote; CAD 25,000 - 33,000; Full time

Benefits offered by this job

Flexible schedule

Freelance/1099 contract

Free access to leading LLMs worth $200

Global expert community

Job summary

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to determine which follows the prompt better.

You will write brief, evidence-based explanations in English describing what looked or sounded wrong, and you can set your own schedule as a freelancer. This 1099 contract offers weekly payments and flexible remote work.

Qualifications

• Fluent English with strong written communication.
• Detail oriented with patience to review outputs.
• Ability to explain decisions clearly in writing.
• Freelance/contract work setup.
• Bachelor’s degree preferred.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank naturalness and usefulness of responses.
• Compare AI-generated images and videos and judge adherence to prompts.
• Write concise explanations of observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Independent work

Bachelor’s degree preferred

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to determine which follows the prompt better.

You will write brief, evidence-based explanations in English describing what looked or sounded wrong, and you can set your own schedule as a freelancer. This 1099 contract offers weekly payments and flexible remote work.