Remote AI Media Evaluator: Images, Video & Dialogue

Scale AI; Greater Sudbury; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Collaborative projects

Job summary

OutlierExperts, operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain issues in writing, all on your own schedule and remotely.

Responsibilities include ranking naturalness, comparing images/videos, and writing evidence-based explanations. Ideal candidates are fluent English and highly detail-focused, with a Bachelor’s degree or higher as a plus.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail, with patience to listen closely and replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot distortions, flickering, or misaligned audio.
• Write concise explanations in English detailing what you saw or heard.

Skills

Attention to detail

English fluency

Clear written communication

Decision making under uncertainty

Education

Bachelor’s degree or above

Job description

OutlierExperts, operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain issues in writing, all on your own schedule and remotely.

Responsibilities include ranking naturalness, comparing images/videos, and writing evidence-based explanations. Ideal candidates are fluent English and highly detail-focused, with a Bachelor’s degree or higher as a plus.