Remote AI Evaluation Specialist

Scale AI; North Battleford; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Weekly payments

Free access to leading LLMs

Job summary

Scale AI is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain issues in writing.

Tasks include comparing AI-generated images and videos to prompts and inspecting for distortions and misalignment, all from a remote, flexible schedule. Ideal candidates are fluent in English with strong written communication and attention to detail.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in on content.
• Able to describe in writing what looked or sounded wrong.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot problems (distortions, artifacts, misalignment).
• Provide written explanations citing observations for each reviewed item.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decisive when trade-offs exist

Education

Bachelor's degree or above (nice to have)

Job description

Scale AI is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain issues in writing.

Tasks include comparing AI-generated images and videos to prompts and inspecting for distortions and misalignment, all from a remote, flexible schedule. Ideal candidates are fluent in English with strong written communication and attention to detail.